-- Logs begin at Thu 2022-05-12 13:48:47 UTC, end at Thu 2022-05-12 15:09:13 UTC. -- May 12 14:22:37.349024 dv-cinder-840678-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 14:22:37.357698 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 14:22:37.360514 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:22:37 2022] *** May 12 14:22:37.360730 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:22:37.360844 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:22:37.360958 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: nodename: dv-cinder-840678-8-iscsi May 12 14:22:37.361243 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: machine: x86_64 May 12 14:22:37.361869 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: clock source: unix May 12 14:22:37.361985 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: pcre jit disabled May 12 14:22:37.362092 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: detected number of CPU cores: 4 May 12 14:22:37.362194 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: current working directory: / May 12 14:22:37.362288 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: detected binary path: /usr/bin/uwsgi-core May 12 14:22:37.362394 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: your processes number limit is 47680 May 12 14:22:37.362497 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: your memory page size is 4096 bytes May 12 14:22:37.362598 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: detected max file descriptor number: 2048 May 12 14:22:37.362728 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: lock engine: pthread robust mutexes May 12 14:22:37.362992 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: thunder lock: enabled May 12 14:22:37.363288 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 14:22:37.363468 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:22:37.409842 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: Python main interpreter initialized at 0x55710c5c39c0 May 12 14:22:37.409842 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: python threads support enabled May 12 14:22:37.409842 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: your server socket listen backlog is limited to 100 connections May 12 14:22:37.409842 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: your mercy for graceful operations on workers is 90 seconds May 12 14:22:37.410217 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:22:37.410281 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: *** Operational MODE: preforking *** May 12 14:22:37.410549 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: *** uWSGI is running in multiple interpreter mode *** May 12 14:22:37.410549 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: spawned uWSGI master process (pid: 80022) May 12 14:22:37.410756 dv-cinder-840678-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 14:22:37.412619 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: spawned uWSGI worker 1 (pid: 80037, cores: 1) May 12 14:22:37.412953 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: spawned uWSGI worker 2 (pid: 80038, cores: 1) May 12 14:22:37.414244 dv-cinder-840678-8-iscsi devstack@keystone.service[80022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:22:43.073913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:43.073913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes May 12 14:22:43.074665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:43.074665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: from cryptography.utils import int_from_bytes May 12 14:22:43.075063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:43.075063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: from cryptography.utils import int_from_bytes May 12 14:22:43.075622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:43.075622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: from cryptography.utils import int_from_bytes May 12 14:22:43.122894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:22:43.123074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:22:43.123290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] command line args: [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:22:43.123492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:22:43.123586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:22:43.123651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ================================================================================ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:22:43.123745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:22:43.123910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] command line args: [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:22:43.123989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_dir = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:22:43.124322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ================================================================================ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:22:43.124385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] config_source = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] admin_token = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] debug = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_dir = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.124914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] config_source = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] debug = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.127645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.128071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.128274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.128467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.128577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.128845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_config_append = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_dir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.129782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.130275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.130275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_config_append = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.130697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.130865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.131059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.131255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_dir = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.131445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.131635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.131888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.132061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.132259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.132458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.132662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.132836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.133981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.134967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.135873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] publish_errors = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] publish_errors = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.136905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] standard_threads = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.137901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138053 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_journal = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] standard_threads = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_json = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.138899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_stderr = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] use_syslog = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_journal = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.139978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_json = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.139978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_stderr = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.140246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.140375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] use_syslog = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.140510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.140639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:43.140771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.140899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.141693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.142102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.142386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.142605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.142825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.142963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.143977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.144912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.145961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.146885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.147988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.148889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.149877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.150858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.151962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.152997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.153131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.153266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.154533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.154710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.154906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.155100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.155335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.155501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.155753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.155920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.156150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.156314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.156540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.156705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.156959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.157163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.157340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.157756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.158105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.158423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.158592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.158786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.158976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.159168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.159399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.159566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.159802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.160915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.161987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.162976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.163932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164611 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.164877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.165898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.166948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.167984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.168895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.169961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.170891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.171979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.external = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.172897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.173420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.password = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.173592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.173805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] auth.token = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.173805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.external = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.174953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.password = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.175902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] auth.token = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.176963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.177895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.178957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.179991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.180938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.181991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.182983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.183111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.183247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.183379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.183519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.183648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.184946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.185874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.186949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.187892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.188921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.189920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.190987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.191939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.192878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.193922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.194853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.195975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.196889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.197814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.198983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.199936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.200981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.201924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.202976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.203987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.204116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.204317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.204498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.204718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.204936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.205983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.206954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.207905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.208975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.209955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.210993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211530 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.211988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.212927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.213975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.214887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.215961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.216915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.217961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.218870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.219969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.220147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.220358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.220575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.220787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.220944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.221918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.222874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.223876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.224988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.225983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.226941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.227952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228780 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.228924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.229903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.230605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.231860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:43.232991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:22:43.237110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.237337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.237556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.241221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.241459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.241686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.246238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.250636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.279279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.279653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.281990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.282232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.335859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.337021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.387041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.387388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.387915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.388128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.453594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.453910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.454068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.454233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.454599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.454801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.456983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.457194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.457404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.457642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.457844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.458667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.478421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.478700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.478853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.479992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.480183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.480321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.480470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.480470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.491093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.491324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.506894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80038) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.507948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80037) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:22:43.524423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.524656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:22:43.524954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.525173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.525328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:22:43.525485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:22:43.525634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.525773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.525910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:22:43.526195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.526606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.537108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.537361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.537610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.537815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.537983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.538128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.538268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.538414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.546012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.546431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.549691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.549942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.550104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.550248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.550403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.550584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.550735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.550874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.551962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.552939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.579054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.579422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.580719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.580962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.581142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.581290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.586488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.586689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.586853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.587010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.587154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.587308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.594230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.594441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.594609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.594756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.599175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.599385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.599550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.599728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.599892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.600896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.601035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.601174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.601321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.601461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.619794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.620003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.620165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.620309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.624524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.624734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.628196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.628460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.628623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.628782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.633421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.633749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.636980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.637368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.640666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.640954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.641995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.642133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.642269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.642416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.642555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.661003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.661376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.661611 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.661889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.662093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.662257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.662510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.662749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.669721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.670745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.671417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.671654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.672486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.672736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.675348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.675598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.675918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.676167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.676331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.676543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.676718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.676718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.676985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.677266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.689789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.690040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.690335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.690618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.690821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.690986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.691888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.692028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.692313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.709255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.710304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.712516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.713583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.715802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.716879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.717377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.718468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.718977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.719196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.719504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.720164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.720598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.720891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.728468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.730076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.731536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.733154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.733360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.733543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.733851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.734088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.736374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.736627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.736933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.737180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.743359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.743656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.743929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.746337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.746627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.746872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.752067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80038) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.752321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.752623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.752870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.753156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.753438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.753677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.753971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.754210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.754504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.754719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.755023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.755276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.755825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80038) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.758277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80037) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:22:43.758540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.758839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.759080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.759408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.759785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.759986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.760243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.760487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.761397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.761670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.761928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.762185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.762503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80037) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:22:43.794803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55710c5c39c0 pid: 80038 (default app) May 12 14:22:43.798670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33f73-06f6-4dc9-9e9b-070140fcb724 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:43.798971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33f73-06f6-4dc9-9e9b-070140fcb724 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:43.799258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33f73-06f6-4dc9-9e9b-070140fcb724 None None] PATH_INFO: `/v3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:43.801943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55710c5c39c0 pid: 80037 (default app) May 12 14:22:43.803530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Thu May 12 14:22:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:22:51.731306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:51.731927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:51.731927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:51.736452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:22:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:22:51.741799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:51.742256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:51.742349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:51.774854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG oslo_db.sqlalchemy.engines [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:51.962334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG passlib.handlers.bcrypt [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80038) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 14:22:51.962757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG passlib.handlers.bcrypt [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80038) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 14:22:52.018203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:52.019756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:52.146649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:22:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 14:22:52.318743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:52.355317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG oslo_db.sqlalchemy.engines [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:52.484657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d177-21be-409e-9a87-9e17d7dd2077 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:52.489713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:52.490389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:52.490675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:52.490929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:52.499408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:52.553140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 14:22:52.553487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f038-535e-4fb4-863b-f9a1b927e0da admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:52.563511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Thu May 12 14:22:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:22:52.569809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:52.584701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fdb22-30fb-4776-8915-63340f01d9dd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:52.590414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:52.591545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:52.591862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:52.592136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] PATH_INFO: `/v3/projects/da529673a2b348db8fa8b2ebc5773804` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:52.593879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=da529673a2b348db8fa8b2ebc5773804)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:52.645172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 14:22:52.645519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151b9b4-75ef-4562-b7de-49ae932be2cc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:52.650310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Thu May 12 14:22:52 2022] GET /identity/v3/projects/da529673a2b348db8fa8b2ebc5773804 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:22:54.897496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235070d-2faa-48b3-b5d4-b38a830a738f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:54.898026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235070d-2faa-48b3-b5d4-b38a830a738f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:54.898026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235070d-2faa-48b3-b5d4-b38a830a738f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:54.902266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:22:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:22:54.910416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9868-234c-4287-87ee-de3573599fbc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:54.910859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9868-234c-4287-87ee-de3573599fbc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:54.910961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9868-234c-4287-87ee-de3573599fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:54.934757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-372d9868-234c-4287-87ee-de3573599fbc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:54.936344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-372d9868-234c-4287-87ee-de3573599fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:54.945937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:22:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 14:22:54.969701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235070d-2faa-48b3-b5d4-b38a830a738f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:54.991401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235070d-2faa-48b3-b5d4-b38a830a738f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:55.000606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:55.001532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:55.001833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:55.002102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:55.010186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:55.011995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9c531-7f69-49f1-8ca4-2806b29c88e6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:55.020920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Thu May 12 14:22:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:22:55.026973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d9868-234c-4287-87ee-de3573599fbc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:55.039334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d9868-234c-4287-87ee-de3573599fbc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:55.045762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:55.046650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:55.046933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:55.047210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:55.048978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:55.050823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4cf4-d17f-4b87-a5ac-167d64a28d7b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:55.052552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Thu May 12 14:22:55 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:22:57.327615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2f76-e718-40cd-a45c-48b2f4a5c514 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.328204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2f76-e718-40cd-a45c-48b2f4a5c514 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.328204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b2f76-e718-40cd-a45c-48b2f4a5c514 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.329795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:57.334951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.335360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.335594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.352348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd8ad-0010-462b-bf51-ef24f22b9ecb None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.352632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd8ad-0010-462b-bf51-ef24f22b9ecb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.352907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd8ad-0010-462b-bf51-ef24f22b9ecb None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.354283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:57.360196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.360523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.360801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.403417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80037) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 14:22:57.403864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG passlib.handlers.bcrypt [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80037) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 14:22:57.450921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:57.452612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:57.469656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:57.470995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:57.552716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:22:57.554585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:22:57.575655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:57.575833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:57.672212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad4c1-f5ec-4976-897b-e81788026b20 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:57.680428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1da531-8883-4cfa-a9a6-d547691d8944 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:57.705662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:57.706727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.707015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.707294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.714851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:57.715525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.715853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.716137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.718743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:22:57.730278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:22:57.731304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:22:57.732167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 8/14] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:22:57.738217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:57.783229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:57.784746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:57.836586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb346-d0fc-4718-82aa-88c18e3992bb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:57.871581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:57.872278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.872560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.872845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.873586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:22:57.873898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:57.875356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:57.882451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 7/15] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:22:57.888417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:57.889463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:22:57.897882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:57.993725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec68-c798-4556-a066-f522e191cb02 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:58.031372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:58.032349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:58.032644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:58.032888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:58.044001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:58.045506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:22:58.067356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:22:58.068385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:22:58.069181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:22:58.069181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:22:58.069181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:22:58.069181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:22:58.069181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 8/17] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:22:58.074749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:58.111624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a978-42d3-4a42-95c0-2a858f46bf73 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:58.143993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:58.144881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:58.145166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:58.145446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:58.147022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:58.148541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:58.150126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:22:57 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:22:58.155636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:58.178243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb92d35-1f9d-4526-a603-625735a09683 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:58.211233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:58.211932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:58.212217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:58.212484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:58.213213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:22:58.213525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:58.214925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:58.231901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:22:58.256935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bcf0-15b7-40aa-9759-5c781b0b088e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:58.294990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:58.295861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:58.296145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:58.296425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:58.297750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:58.299910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c56e-b253-45db-8269-da2f6454743c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:58.301595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:22:58.307906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:58.420004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067eda-a293-436e-a705-847860b28d26 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:58.456107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:58.456773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:58.457075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:58.457353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:58.458206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.domain.id=default, user.id=fa9ac61b8632465586bee816b0404515) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:22:58.458510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:58.460004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092739-ec64-4492-bf5a-f2e871af1d73 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:58.467015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1322 bytes} [Thu May 12 14:22:58 2022] GET /identity/v3/role_assignments?user.id=fa9ac61b8632465586bee816b0404515&scope.domain.id=default&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:00.934332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f994b6-3676-45d2-91a5-bccc682fea1f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:00.935337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f994b6-3676-45d2-91a5-bccc682fea1f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:00.935863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f994b6-3676-45d2-91a5-bccc682fea1f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:00.937772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:00.943722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d189f-7feb-429c-be92-ab5d1c432298 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:00.944586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d189f-7feb-429c-be92-ab5d1c432298 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:00.945095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d189f-7feb-429c-be92-ab5d1c432298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:00.963166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ad5d189f-7feb-429c-be92-ab5d1c432298 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:00.964888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ad5d189f-7feb-429c-be92-ab5d1c432298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:01.034931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:01.058330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f994b6-3676-45d2-91a5-bccc682fea1f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:01.144737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6e6c-4f2f-4e9e-947e-c6cb635a3e6a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.145068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6e6c-4f2f-4e9e-947e-c6cb635a3e6a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.145305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6e6c-4f2f-4e9e-947e-c6cb635a3e6a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.146946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:01.151995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.152533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.153008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.177921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:01.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:01.195011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f994b6-3676-45d2-91a5-bccc682fea1f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:01.275062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:01.275905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.276194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.276475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.297140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:01.313500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:01.314793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:01.315553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 13/25] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:01.322839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:01.366364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 13/26] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:01.436189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:01.463107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ccee-1130-4fc9-b30e-b74d6afd6e88 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:01.503408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:01.504126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.504410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.504686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.505461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:01.505768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:01.507176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4f075-3ad3-48bf-ab44-480323d8659d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:01.521909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 14/27] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:01.523537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f72f6-88e3-4640-a4d7-488332875272 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.524069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f72f6-88e3-4640-a4d7-488332875272 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.524540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f72f6-88e3-4640-a4d7-488332875272 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.525960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 15/28] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:01.527680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f72f6-88e3-4640-a4d7-488332875272 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:01.644082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef94c4-ae34-4f94-b6a5-e307897caaac None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:01.684781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:01.685882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.686415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.686898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.687915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:01.689932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4deac-0eac-4b34-b776-d24c51bc462d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:01.705542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f72f6-88e3-4640-a4d7-488332875272 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:01.739125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:01.740039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.740320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.740591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.741793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:01.743240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17c95a-f949-4bb0-a571-bf9baf474784 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:01.745264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 16/29] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:01 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:01.746555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.746861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.747108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.764279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:01.765555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:01.847530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 14/31] 10.222.0.79 () {60 vars in 1131 bytes} [Thu May 12 14:23:01 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:01.848011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 17/31] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:01.848975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:01.849866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3e74-94fe-45f3-9477-ebcb827bb415 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.850366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3e74-94fe-45f3-9477-ebcb827bb415 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.850869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3e74-94fe-45f3-9477-ebcb827bb415 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.853068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 15/32] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:01.873257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:01.873928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:01.874399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:01.909306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:01.919728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.027266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 16/33] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 12 14:23:02.036251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.037230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa2864-05ab-40ef-b8eb-d22e3c25f860 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.075130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.076371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.076858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.077331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.078755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.080936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.083159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 18/34] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:02.084187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.153494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d54d3-30d5-40e6-bbf1-05604053331e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.187755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe679a-cee5-40a9-89b4-60bfe717dc35 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.188878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.189580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.189866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.190148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.190915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.192576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.211602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 17/35] 10.222.0.79 () {60 vars in 1131 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/roles => generated 225 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:02.212780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.250535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.251991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.252558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.252781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.278069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.279438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2c6ce3df-fcaf-4ced-9eaf-7b1d5b638014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:23:02.303267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:02.304229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:02.305020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:23:02.305020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:23:02.305020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:23:02.305020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:02.305220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 19/36] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:02.306801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7e5b-8dd9-4e2f-a96e-f81d61b2cdb9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.307187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7e5b-8dd9-4e2f-a96e-f81d61b2cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.307609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7e5b-8dd9-4e2f-a96e-f81d61b2cdb9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.309379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 20/37] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:02.310207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7e5b-8dd9-4e2f-a96e-f81d61b2cdb9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.354542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6dc1-9cb3-4715-8fb9-1d065b4ccde0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.399704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.400782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.401208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.401597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] PATH_INFO: `/v3/domains/default/users/fa9ac61b8632465586bee816b0404515/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.403937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fa9ac61b8632465586bee816b0404515, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.405678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86d8de-56f2-43b6-90a7-73a9be8c2c0e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.426744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 18/38] 10.222.0.79 () {58 vars in 1361 bytes} [Thu May 12 14:23:02 2022] PUT /identity/v3/domains/default/users/fa9ac61b8632465586bee816b0404515/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:02.428439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6401e3-3d9d-4f0d-bece-6a55c9116afb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.428853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6401e3-3d9d-4f0d-bece-6a55c9116afb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.429243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6401e3-3d9d-4f0d-bece-6a55c9116afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.452482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0a6401e3-3d9d-4f0d-bece-6a55c9116afb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:02.454003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0a6401e3-3d9d-4f0d-bece-6a55c9116afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.460315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7e5b-8dd9-4e2f-a96e-f81d61b2cdb9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.505209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.506560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.506844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.507118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.507920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:02.508233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.510217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.540651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 21/39] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:02.547315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.561646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 19/40] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:02.584862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d208f4-6a39-4c43-a807-ae93d31a2426 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.585128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d208f4-6a39-4c43-a807-ae93d31a2426 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.585424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d208f4-6a39-4c43-a807-ae93d31a2426 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.587003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 20/41] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:02.593313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.593612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.593881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.620239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:02.621701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.668876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a23d-2817-4be5-aefd-cb214dc66d66 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.695359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 21/42] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:02.696338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.709983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.711282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.711733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.712233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.713701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.715634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.799448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e836637-2b6b-44f8-ae4f-9397c9089644 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.842405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.843332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.843609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.843921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.845844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.847393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.854244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 22/43] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:02.854244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.868268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 22/44] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:23:02.868268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.987459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109824c-e7d9-4539-b6a4-058c6d6eccb8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.987661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2f907-a166-4044-9a8e-8fb9d1fd81ad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:03.025321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:03.026129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:03.026490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:03.026865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:03.027416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:03.027905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:03.028367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:03.028782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:03.029161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:03.029389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1ec8-8971-4dae-b909-da38340efb44 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:03.030126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:03.031724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60214fb5-703b-4b9a-b1d2-acbba7b7a1d3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:03.050747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1131 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:03.060677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 23/46] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:04.691915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143449f2-5328-48b4-b9d7-4290050cd8d6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:04.692486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143449f2-5328-48b4-b9d7-4290050cd8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:04.692486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143449f2-5328-48b4-b9d7-4290050cd8d6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:04.693880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 24/47] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:04.699586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:04.700005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:04.700188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:04.718975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:04.720993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:04.791278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 24/48] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:04.815182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143449f2-5328-48b4-b9d7-4290050cd8d6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:04.920084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143449f2-5328-48b4-b9d7-4290050cd8d6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:04.955641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:04.956406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:04.956693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:04.956973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:04.968530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:04.977598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:04.978549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:04.979339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 25/49] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:04.984647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.084347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7d06-1194-4917-b4f9-27bfc5ec1019 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.117774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.118449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.118732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.119011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.119794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:05.120108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.121493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.130623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 25/50] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:05.136622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.242238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a889df3-cd1d-43bb-ba57-2e6e0269491b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.275609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.276520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.276805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.277086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.278298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.279815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d435ec-ee76-40b3-9622-ade2aedb9c7b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.281471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 26/51] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:05 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:05.287098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.320852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb75cac-b072-4c18-99d6-a3c91e3c3811 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.321149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb75cac-b072-4c18-99d6-a3c91e3c3811 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.321427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb75cac-b072-4c18-99d6-a3c91e3c3811 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.322768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 27/52] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:05.327929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.328218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.328497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.347016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:05.348245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:05.385558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86317b44-b3d1-4b39-bb08-8c698132ea80 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.415051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 28/53] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:05.418540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.419344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.419634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.419941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.421173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.422673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.424775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 26/54] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:05.430776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.438937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.527613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0ba65-ea49-4486-80bd-741f2fd6e900 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.537941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e3a9f-7b7c-43ac-986d-8ea1360198a6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.564033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.564748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.565032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.565305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.566145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.domain.id=default, user.id=fa9ac61b8632465586bee816b0404515) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:05.566453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.567991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.571156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.571997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.572286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.572562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.573714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.573884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 29/55] 10.222.0.79 () {56 vars in 1322 bytes} [Thu May 12 14:23:05 2022] GET /identity/v3/role_assignments?user.id=fa9ac61b8632465586bee816b0404515&scope.domain.id=default&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:05.575325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bf962-3af0-4f33-9689-9140ad8dd46a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.576996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 27/56] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:05.583017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.697641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3005e-16fb-4722-a4bf-0078a262994f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.734437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.735333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.735626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.735933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.736822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.738336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16a71d-cdab-4430-a2de-599903e13d47 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.769582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 30/57] 10.222.0.79 () {60 vars in 1140 bytes} [Thu May 12 14:23:05 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:23:07.965769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb5ed-cb3d-4a0a-99b3-9879f2f7123e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:07.966305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb5ed-cb3d-4a0a-99b3-9879f2f7123e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:07.966305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb5ed-cb3d-4a0a-99b3-9879f2f7123e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:07.967675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 28/58] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:07.973280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:07.973693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:07.973796 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:07.992661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:07.993849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:08.082147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 31/59] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:08.105769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb5ed-cb3d-4a0a-99b3-9879f2f7123e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:08.215174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb5ed-cb3d-4a0a-99b3-9879f2f7123e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:08.248583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:08.249373 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:08.249657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:08.249934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:08.251206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:08.252701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbae47-a550-426f-8c0f-93c19b1c9953 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:08.254293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 29/60] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:08.260150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:08.365871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c650d4-67ad-4f1f-aca0-299f21f8fbd4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:08.400529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:08.401202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:08.401490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:08.401768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:08.402489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:08.403984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277b2b-7249-421d-8ccd-b3fa6af8803f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:08.433594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 32/61] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:08 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:11.949377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84734418-2fd1-49c4-a4dc-5d0f4c89a567 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:11.950360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84734418-2fd1-49c4-a4dc-5d0f4c89a567 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:11.950858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84734418-2fd1-49c4-a4dc-5d0f4c89a567 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:11.952472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 30/62] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:11.972565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56273-9d5b-4c74-94c9-e8003b33067f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:11.973067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56273-9d5b-4c74-94c9-e8003b33067f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:11.973166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a56273-9d5b-4c74-94c9-e8003b33067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:11.990683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-49a56273-9d5b-4c74-94c9-e8003b33067f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:11.996045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-49a56273-9d5b-4c74-94c9-e8003b33067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:12.007848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e25f-58a7-43fe-b546-81b64163c9c7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.008485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e25f-58a7-43fe-b546-81b64163c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.008989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e25f-58a7-43fe-b546-81b64163c9c7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.010570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:12.015880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.016503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.016981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.038689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:12.040260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:12.094875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 33/64] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:12.108520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 32/65] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:12.117996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.118545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9b63-7445-47e0-91ca-c34747a5dd96 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.119094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9b63-7445-47e0-91ca-c34747a5dd96 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.119573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9b63-7445-47e0-91ca-c34747a5dd96 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.121423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 34/66] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:12.127192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.127752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.128258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.145333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:12.146883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:12.222079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 35/67] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:12.223740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.223905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0edf93-4dde-42a1-91b0-a24e04f535c8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.267069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.267921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.268212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.268493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.279337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:12.287422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:12.288594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:12.289549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:12.291541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 33/68] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:12.297087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.343425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70de481-6e23-4c84-8b29-ff93185e1113 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.379934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.381021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.381449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.381869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.393556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:12.397766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097010-05be-4ad4-b319-565bbec38957 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:12.402040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:12.403080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:12.403946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 36/69] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:12.404568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.431150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.432001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.432288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.432606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.443641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-229b0986-8ea8-42d3-9020-c22cdb89d99a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:12.451227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:12.452112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:12.452872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 34/70] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:12.454093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f9d5-aa51-4d92-a8f8-48feb035650e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.454093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f9d5-aa51-4d92-a8f8-48feb035650e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.454274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f9d5-aa51-4d92-a8f8-48feb035650e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 35/71] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152033-942d-489f-b115-176a7f2fa017 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152033-942d-489f-b115-176a7f2fa017 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152033-942d-489f-b115-176a7f2fa017 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 36/72] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:12.459964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152033-942d-489f-b115-176a7f2fa017 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.508155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0d0-6314-4df3-b5b1-05fe4a18edc7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.542192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.542874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.543159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.543522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.544311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:12.544625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:12.546035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de374-8d4e-4cac-aa90-5552a6024e0d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:12.558464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:12.559440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152033-942d-489f-b115-176a7f2fa017 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.559620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e22f-4353-4c79-93d8-84347249bd34 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.559977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e22f-4353-4c79-93d8-84347249bd34 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.560262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e22f-4353-4c79-93d8-84347249bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.577120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2894e22f-4353-4c79-93d8-84347249bd34 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:12.578313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2894e22f-4353-4c79-93d8-84347249bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:12.592343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.593019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.593302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.593573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.594355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:12.594724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:12.596141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:12.603766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 37/74] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:12.604532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.646790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 38/75] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:12.648077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.648341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.648625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.665034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:12.666222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:12.705146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb987c94-9b53-4f94-9b22-705d142c40f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.730321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 39/76] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:12.738580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.738694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.739101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.739391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.739678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.740478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:12.740787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:12.742191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:12.750474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 38/77] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:12.751385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.842221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9efc3-836e-47ac-805e-966d53a0d7a5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.853800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e6f9-4551-41ed-b223-6be1401a654c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:12.876589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.877490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.877775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.878053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.886365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:12.887255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:12.887539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:12.887850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:12.891089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:12.892866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:12.894506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 40/78] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:12.895274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.902858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:12.904308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:12.906014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 39/79] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:12.906776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:12.990534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec59df-95f1-4b39-a847-63cd1d3b38ca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.010537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ddddb-f63e-4f14-82fb-d7ff7bdc1105 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.024561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.025372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.025660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.025930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.036183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:13.043748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:13.044618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:13.045380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:13.045964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.045964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.045964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.046160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 41/80] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:13.046223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.046285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.047237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.049133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.051300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 40/81] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.052032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.144095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b854a-dd81-4fce-bcfd-59c1d46dba69 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.147009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2530-d6fb-470f-a053-919880a4c2c2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.178579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.179400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.179720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.180005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.181229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.182076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.182695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.182790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.183007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.183288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.184395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 42/82] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.185147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.249350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.250870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.277556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700f0cf-8586-4220-88aa-a1e68e7707df None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.309633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.310293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.310573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.310856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.346403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 41/83] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:13.347261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.376727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.378215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.442651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a207-53f8-454f-b3e6-a2ed430a3c51 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.471914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:13.472772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.477924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.478596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.478878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.479156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.479927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:13.480240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.481619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.489739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 42/85] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.490517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.570369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712dbe-db5c-44b5-852a-4d775f0716c2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.589456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d88a2-cebd-40f4-aab1-4b8649491d2d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.604696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.605425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.605704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.605983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.606704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.608211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.623508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.624181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.624505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.624729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.629195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 44/86] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:13 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:13.630004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.696743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.698178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.737925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db68f-6aa3-460c-98b8-fe79a3af25e0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.775032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.776293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.776578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.777113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.778097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.779591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.786688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 45/87] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.786688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.806908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 43/88] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:13.807191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.890694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dd4ef-bfab-41d1-8023-f3bcbce2e4b6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.908040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c2a6-c2af-42d0-9d9d-814959132c6c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:13.935585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.936655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.936830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.937802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.938498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.940101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.941846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 46/89] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.942685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:13.960170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:13.961031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:13.961328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:13.961607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:13.962841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:13.964400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:13.966051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 44/90] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:13.966823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.047210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8abe7-b80a-41d9-ad99-d53dd8eb9e87 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.071546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60dc0-5728-4aff-a757-3847d9bcaec9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.082735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.083778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.084260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.084749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.085835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:14.086344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.088039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.094356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 47/91] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:14.095429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.122846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.123837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.124127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.124406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.125896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.127494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.129869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 45/92] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:13 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:14.130789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.203756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b48b6-4098-44ab-92e9-779c8cfe0a6e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.240063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd9ba-7df6-4b0b-bb3a-c08d572ac39e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.240703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.241603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.242086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.242571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.243840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:14.244383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.246243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.252966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 48/93] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:14 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:14.254150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.278830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.279395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.279705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.279995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.366383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043a9f2-c98b-42b1-9d23-751cac8b02c4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.403514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.404614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.405096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.405569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.406660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=fa9ac61b8632465586bee816b0404515) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:14.407278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.409172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.415907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 49/94] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:14 2022] GET /identity/v3/role_assignments?user.id=fa9ac61b8632465586bee816b0404515&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:14.446993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.448528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.553391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 46/95] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:14.558961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.690461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7e968-2812-4c75-9a33-c5fbd4d0ff50 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.726644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.727914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.728417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.728889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] PATH_INFO: `/v3/projects/f7744e8658e34373ad54c4cb1315daf1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.730294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f7744e8658e34373ad54c4cb1315daf1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.731983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8f099-fe10-4a47-a9a2-ce17058022a7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.734199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 50/96] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:14 2022] GET /identity/v3/projects/f7744e8658e34373ad54c4cb1315daf1 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:14.739863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:14.850992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f951-b716-48fa-9337-69ef356e88b2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:14.895232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:14.895959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:14.896248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:14.896532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:14.897389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=f7744e8658e34373ad54c4cb1315daf1, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:14.897709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:14.899185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa9af-3e80-4775-8b5f-7bff292a03e4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:14.910440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 47/97] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:14 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=f7744e8658e34373ad54c4cb1315daf1&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:16.463144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490584-1203-45c8-bcf1-093f730fd897 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.463724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490584-1203-45c8-bcf1-093f730fd897 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.463724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490584-1203-45c8-bcf1-093f730fd897 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.465274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 51/98] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:16.471338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273995-acee-4759-9e26-a3c11f0cf4ea None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.472205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273995-acee-4759-9e26-a3c11f0cf4ea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.472685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273995-acee-4759-9e26-a3c11f0cf4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.490728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d1273995-acee-4759-9e26-a3c11f0cf4ea None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:16.492282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d1273995-acee-4759-9e26-a3c11f0cf4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:16.573250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 48/99] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:16.609705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490584-1203-45c8-bcf1-093f730fd897 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:16.719043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490584-1203-45c8-bcf1-093f730fd897 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:16.754457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:16.755656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.756167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.756642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.758031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:16.759747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:16.761911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 52/100] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:16.764570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec04ce-bbd4-44ca-807b-bfeb8b7b08b8 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.765144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec04ce-bbd4-44ca-807b-bfeb8b7b08b8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.765624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec04ce-bbd4-44ca-807b-bfeb8b7b08b8 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.768219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 49/101] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:16.769311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:16.787859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.788460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.788953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.812428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:16.822723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:16.963198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 50/102] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:16.971822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c00529-86b7-424b-bb6c-701c33fef709 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.002566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:17.042694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.043872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.044357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.044832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.045772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:17.047518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:17.106539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 53/103] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:23:16 2022] POST /identity/v3/projects => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:17.145832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326eba-a7f8-4bfb-bdd0-5c8d4306b9c2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.185627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.186824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.187331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.187858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.206561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:17.214901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:17.220702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:17.221476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:17.223953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 51/104] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:17.232901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:17.390266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36cc06-027a-453f-b115-cad358c8cf59 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.435365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.436088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.436372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.436650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.437415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:17.437718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:17.439328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25905e-507e-4961-94ca-8aa65c2de032 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:17.451868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 54/105] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:17.457613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:17.544947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b69a0-a24b-435a-bcfb-a2e8e08d9172 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.545450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b69a0-a24b-435a-bcfb-a2e8e08d9172 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.545450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b69a0-a24b-435a-bcfb-a2e8e08d9172 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.547009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 55/106] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:17.553342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.553630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.553911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.577756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:17.579039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:17.604437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d8-da1f-4986-aeda-079cbd11d046 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.682866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 56/107] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:17.683539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.684482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.684771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.685049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] PATH_INFO: `/v3/users/abb87641b5424bf88cb56717b5bfc475` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.708477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] RBAC: Authorizing `identity:get_user(user_id=abb87641b5424bf88cb56717b5bfc475)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:17.709995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:17.712139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 52/108] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:17 2022] GET /identity/v3/users/abb87641b5424bf88cb56717b5bfc475 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:17.717616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:17.734189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:17.836067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45b6e-d98e-429a-af4f-b751f5fcb687 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.879926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.880603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.880885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.881162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.928203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996480-0f44-4657-b525-d1274e59f04c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:17.961122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:17.962996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:17.970481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:17.971309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.971595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.971901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:17.985758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-53d94f04-8da1-4e9b-9486-f30170437340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:17.995556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:17.996532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:17.997299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 53/109] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:17.998528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe924-3170-4db9-a6d4-adfc470d595c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:17.998528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe924-3170-4db9-a6d4-adfc470d595c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:17.998684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afe924-3170-4db9-a6d4-adfc470d595c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.000060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 54/110] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:18.007264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.007862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.008363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.026971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:18.028525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:18.090527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 57/111] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:18.091820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.099871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 55/112] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:18.101080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.215281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c67d39-ad5c-4644-9b0f-9e0cf868684b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.226346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fcef7-cb26-4b78-9c9b-14b10c483678 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.257952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.258754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.259055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.259339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.260175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:18.260487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.262135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e4d0-6095-47e0-9931-10d1a7e98a7d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.263380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.264598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.265093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.265575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.268094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.269939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.272385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 58/113] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.272817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 56/114] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.273492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d6c3a-7119-4a0a-a642-e09e33c595a7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.273783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d6c3a-7119-4a0a-a642-e09e33c595a7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.274187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d6c3a-7119-4a0a-a642-e09e33c595a7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.274597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.275588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 59/115] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:18.283664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.284017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.284267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.304717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:18.306278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:18.390635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 60/116] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:18.391453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.392105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94018429-c01a-46ec-9447-96cf6369bf9e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.437299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.439757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.440281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.441080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.456323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:18.465113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:18.466013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:18.466798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 57/117] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:18.467442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.500811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76571e7e-328c-4da2-876f-8a5fce97bc39 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.535214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.536588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.537088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.537508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.538734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.540316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.546391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 61/118] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.546391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.581916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880410-9071-4e97-98de-31e2e5fed6de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.617423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.618083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.618380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.618664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.619506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=abb87641b5424bf88cb56717b5bfc475) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:18.619861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.621351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82df7-02bc-4d4c-a88b-ad14e6d0cdd9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 58/119] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/role_assignments?user.id=abb87641b5424bf88cb56717b5bfc475&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763572a1-14f6-40da-8334-26be4733d9a4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763572a1-14f6-40da-8334-26be4733d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763572a1-14f6-40da-8334-26be4733d9a4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 59/120] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:18.636220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763572a1-14f6-40da-8334-26be4733d9a4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.664237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c99e-afea-485f-8861-37b256050292 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.704139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.705146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.705657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.706433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.721570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:18.732496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:18.733603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:18.734606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:18.736227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 62/121] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:18.737625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.755089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763572a1-14f6-40da-8334-26be4733d9a4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.801636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.802695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.802994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.803278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.804106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:18.804421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.806394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629b1de-9506-4a2a-ad4a-0f0b715d69d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.826229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 60/122] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.827838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.828310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.828898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.856854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:18.858063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:18.880418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9346e-8f43-444f-90af-35e936895966 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:18.914868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:18.915787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:18.916079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:18.916402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:18.917723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:18.919354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:18.921772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 63/123] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:18.927118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:18.947726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 61/124] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:18.949020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.040675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5742f3-bcc1-4931-9a57-74624b8820fc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.068548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9996-ac72-4b24-8bc6-e8af883db238 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.083952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.084674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.085342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.085638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.086757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:19.087081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.088941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.099777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 64/125] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.101497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.114246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.115485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.115979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.116435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.117851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.119507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.121356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 62/126] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:18 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.122308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.226550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e92c1-2746-41a0-b4a4-97ae12ea1190 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.227269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195394-5f3e-46df-b402-c998e990d956 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.262249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.263404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.264004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.264494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.267180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.268422 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.268710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.268994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.271269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, user_id=b5cc0d3ae6204c1097ca734a1ae8b884, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.272938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.276415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:19.284862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:19.285777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:19.286577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:19.289185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 65/128] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:19 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:19.289406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 63/127] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:19.289834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.290711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.492502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f458b53-de6c-4410-bb46-e2ace20c2747 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.499067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6e54-0117-4235-8bc0-f42f4d831e9b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.535238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.536632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.537605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.538087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.539736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.541780 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.543809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 64/129] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.545163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.562383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.563657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.564239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.564627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.566410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.569474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.570111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 66/130] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.570973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.669081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad006-4078-4011-b06f-1dcc4274becb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.691828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb05a-d27d-4573-8037-5dd807027d9d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.713396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.714246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.714632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.715167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.716379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:19.717081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.719049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.726685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.727910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.728341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.728800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.729880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 65/131] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.730796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.732017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, user_id=b5cc0d3ae6204c1097ca734a1ae8b884, role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.733735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.756746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 67/132] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:19 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:19.757900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.857711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402465c2-ec80-48f1-867e-64aefd3715ae None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.906099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.907104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.907391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.910827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.914090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.915623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.923654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 66/133] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:19.945145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2fc6-e757-440a-8b45-c3701eba3565 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.950047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:20.034076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.035354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.035856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.036341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.040638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.042496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.044581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 68/134] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:20.050765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:20.093792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea3f6f-0f9c-49d1-bea2-7bdc1fbff65c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:20.175123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.176093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.176382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.176662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/fa9ac61b8632465586bee816b0404515/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.180067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, user_id=fa9ac61b8632465586bee816b0404515, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.181561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40791a-ae91-4653-9ad9-d57d07e04d44 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.214508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 67/135] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:19 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/fa9ac61b8632465586bee816b0404515/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:20.249455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57491-2d4c-432e-843e-7aa74c84cfb6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:20.261507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e64-ae70-4f93-bed7-b5f754e67bfc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.261816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e64-ae70-4f93-bed7-b5f754e67bfc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.262070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e64-ae70-4f93-bed7-b5f754e67bfc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.263639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 68/136] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:20.269595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.269939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.270160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.297612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:20.299173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:20.346071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.346983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.347265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.347537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] PATH_INFO: `/v3/projects/f7744e8658e34373ad54c4cb1315daf1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.351886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f7744e8658e34373ad54c4cb1315daf1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.353391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.355198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 69/137] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:20 2022] GET /identity/v3/projects/f7744e8658e34373ad54c4cb1315daf1 => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:20.362268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:20.463240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 69/138] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:20.509199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:20.521209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d18d8-12c9-438a-aee0-98af6dba87c2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:20.558835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.560003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.560293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.560575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] PATH_INFO: `/v3/projects/f7744e8658e34373ad54c4cb1315daf1/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.569519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7744e8658e34373ad54c4cb1315daf1, user_id=b5cc0d3ae6204c1097ca734a1ae8b884, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.571423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.591808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 70/139] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:20 2022] PUT /identity/v3/projects/f7744e8658e34373ad54c4cb1315daf1/users/b5cc0d3ae6204c1097ca734a1ae8b884/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:20.675299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7c66-b316-45c1-93f9-666376eb012d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:20.717134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.717961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.718298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.718583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.720033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.721578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127f8d9-b020-464d-b0af-7c4a986726ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.723576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 70/140] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:20.728929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:20.867714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623643e4-9cc7-4a4d-9de9-707b85d10ce4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:20.905901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:20.907153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:20.907452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:20.907759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:20.908570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:20.910046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65bf23-eaeb-43f8-8e08-f17581940f3a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:20.941528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 71/141] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:20 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:21.511287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598496-2811-4b49-9ddd-fe1ea19be999 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:21.511711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598496-2811-4b49-9ddd-fe1ea19be999 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:21.511898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598496-2811-4b49-9ddd-fe1ea19be999 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:21.513583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 71/142] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:21.519816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:21.520115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:21.520398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:21.538206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:21.539429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:21.626313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 72/143] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:21.660564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598496-2811-4b49-9ddd-fe1ea19be999 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:21.788924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598496-2811-4b49-9ddd-fe1ea19be999 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:21.826540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:21.827373 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:21.827660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:21.827974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:21.839777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:21.847995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:21.848877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:21.849631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 72/144] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:21.855965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:21.962006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b4afa-dc6b-4e56-a754-117e376ab5f7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:21.997046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:21.997748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:21.998037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:21.998319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:21.999087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:21.999399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:22.001331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:22.011366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 73/145] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:22.017338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:22.127921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211975d-11ac-44db-9ddd-c8439a3a111f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:22.163374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:22.164317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.164606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.164890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] PATH_INFO: `/v3/users/abb87641b5424bf88cb56717b5bfc475` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.166099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] RBAC: Authorizing `identity:get_user(user_id=abb87641b5424bf88cb56717b5bfc475)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:22.167566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179de17-7f63-418a-9215-2469eb99c783 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:22.169528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 73/146] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:22 2022] GET /identity/v3/users/abb87641b5424bf88cb56717b5bfc475 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:22.175830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:22.282127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db6fe-b6d6-44f7-b888-2c769cdc4b98 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:22.319075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:22.320055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.320344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.320668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.321910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:22.323393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:22.326277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b817-c857-4c1b-87cd-dc5b53cd26ff None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.326567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b817-c857-4c1b-87cd-dc5b53cd26ff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.326850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b817-c857-4c1b-87cd-dc5b53cd26ff None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.328243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 74/147] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:22.329217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 74/148] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:22 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:22.333936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.334232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.334518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.354261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:22.366032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:22.369485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:22.478470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 75/149] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:22.518135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:22.562308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e30ae7-4b7d-49f1-a17e-33c76c5f5884 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:22.601093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:22.602048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.602333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.602614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/abb87641b5424bf88cb56717b5bfc475/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.604706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, user_id=abb87641b5424bf88cb56717b5bfc475, role_id=4abd7a66f4dc49e28eb7fc18cd3d1d11)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:22.606242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:22.632803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 75/150] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:22 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/users/abb87641b5424bf88cb56717b5bfc475/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:23:22.672159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77bef1-e8c2-4721-8360-ee679f160c40 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:22.715451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:22.716322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.716639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.716922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.737722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:22.745456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:22.747552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:22.749464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:22.758349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:22.905670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4c368-cde2-4f86-a809-af3b8f8c7002 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:22.950851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:22.951561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:22.951903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:22.952184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:22.952961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:22.953272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:22.960861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:22.970615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 76/152] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:22.976728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:23.096168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35273c-1c30-44fa-973f-688ac7158b69 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:23.132445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:23.133360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:23.133643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:23.133921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:23.140517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:23.142401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:23.144525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 77/153] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:22 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:23.149690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:23.268992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd4032-d831-480b-bfb9-16bf162ce009 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:23.307952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:23.308629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:23.308899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:23.309170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:23.378846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:23.380324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:23.480170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 77/154] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:23.485400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:23.599234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a2b1-309a-4150-92b2-0210a31f1d2e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:23.639109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:23.639957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:23.640241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:23.640524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:23.641830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:23.643301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d108e55-4e42-42dd-b16e-f24c34acbbc0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:23.645084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 78/155] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:23 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:23.651197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:23.760785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e3447-b8a7-4593-9428-17cc191e4740 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:23.799570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:23.800279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:23.800560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:23.800831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:23.801678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:23.801990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:23.803450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2748-3c1a-4338-968c-22a073d327af None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:23.809865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 78/156] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:23 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:24.052225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad915-1e69-4e87-b075-1345d74805c1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.052720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad915-1e69-4e87-b075-1345d74805c1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.052720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad915-1e69-4e87-b075-1345d74805c1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.054072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 79/157] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:24.059434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.059742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.060029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.081828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:24.083033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:24.169986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 79/158] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:24.214250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ad915-1e69-4e87-b075-1345d74805c1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.336768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ad915-1e69-4e87-b075-1345d74805c1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:24.375127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:24.376051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.376331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.376602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.393859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aa44718e-6b76-4a7e-abdd-a367b61f0e84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:24.402097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:24.404121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:24.406001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 80/159] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:24.411709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.521044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda63578-255d-446d-a950-6f1b0d285b41 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:24.555233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b33ff-4c1c-427e-84ff-4e02fb65af0c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.555549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b33ff-4c1c-427e-84ff-4e02fb65af0c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.555803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b33ff-4c1c-427e-84ff-4e02fb65af0c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.557189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 81/160] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:24.562721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.563393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.563676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.568966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:24.569665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.569943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.570217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.570987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:24.571286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:24.572983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:24.583101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 80/161] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:24.590870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.595882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:24.597092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:24.704810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53d89-2858-46d1-9c59-8a8fa5f397f8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:24.730339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 82/162] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:24.747066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:24.748002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.748285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.748561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.749784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:24.751396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:24.753069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 81/163] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:24.758584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.758803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.868444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed4ef-3cce-49ef-9577-545ea3d8cc37 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:24.918980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:24.919667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.919973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.920245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.935774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466fa9c-b42a-4079-996e-54f4ad6ffec8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.013114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.013929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.014205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.014474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.034803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b296a5d2-4095-4366-9f74-92aee965183c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:25.043893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:25.045872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:25.047912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 83/164] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:25.054632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837370-561a-43ae-9463-56b633a0a5ab None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.054632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837370-561a-43ae-9463-56b633a0a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.054632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837370-561a-43ae-9463-56b633a0a5ab None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.054632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 84/165] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:25.057350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837370-561a-43ae-9463-56b633a0a5ab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.062762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:25.064379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed22a-b66d-43e2-8e55-03bd2dbb6d32 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:25.231341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 82/166] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:25.232595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.232877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.233147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.241096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837370-561a-43ae-9463-56b633a0a5ab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.262003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:25.263192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:25.301705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.302382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.302660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.302932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.303704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:25.304012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:25.305407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:25.318315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 85/167] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:25.319116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.374168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 83/168] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:25.375019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.486438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ba0d1-cced-489b-993e-48538f8c50ea None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.542688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a27dc-6d61-4d93-80be-eab51845bd11 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.546671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.547894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.548671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.549121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.550501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:25.552167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:25.554085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 86/169] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:25.555033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.602912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.604148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.604604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.605072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] PATH_INFO: `/v3/users/fa9ac61b8632465586bee816b0404515` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.607488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] RBAC: Authorizing `identity:get_user(user_id=fa9ac61b8632465586bee816b0404515)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:25.609165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:25.611761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 84/170] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/users/fa9ac61b8632465586bee816b0404515 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:25.613334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.713551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15649-20e4-4065-bf99-78983a27b1d4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.754562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.755622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.760673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.761107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.779970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:25.789839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:25.790835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:25.791620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:25.794199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 87/171] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:25.795180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.817971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038177-ac74-48ce-af0f-ed0c6f37795d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:25.859757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:25.860931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:25.862493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:25.862911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:25.864831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:25.865939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:25.869822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:25.882628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 85/172] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:25.884599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:25.976760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44d89-4e52-4a68-9dd9-6292ef125e31 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.021294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.021885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.022162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.022435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.113996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba357-4a2d-4f77-8a2f-ecb222a58161 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.130576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.132833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.203058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.204247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.204730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.205220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.206205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:26.207003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.208854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.226591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 86/173] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:26.232120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.305613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 88/174] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:26.311028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.375639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5b8c0-71e3-405b-8d00-23d2c6d74cfe None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.425184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.426445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.426867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.427288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] PATH_INFO: `/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.428725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] RBAC: Authorizing `identity:get_user(user_id=b5cc0d3ae6204c1097ca734a1ae8b884)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.430341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c63d4-f0e1-40df-9c0a-d87c83abbf80 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.432647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 87/175] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/users/b5cc0d3ae6204c1097ca734a1ae8b884 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:26.433990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001ed3-8273-435a-844f-98af16d2fcb5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.434411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001ed3-8273-435a-844f-98af16d2fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.434819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001ed3-8273-435a-844f-98af16d2fcb5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.440933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 88/176] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:26.442481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001ed3-8273-435a-844f-98af16d2fcb5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.486946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ddf3e-8f3b-459e-ad1a-f1fdba194684 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.537673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.539016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.539300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.539576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.541527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.543489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824dc26-cd80-4372-8378-b327bfb1d1c2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.545983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 89/177] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:26.547342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07265-90ef-49b2-8e6d-4dcd60c0a320 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.547630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07265-90ef-49b2-8e6d-4dcd60c0a320 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.548578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07265-90ef-49b2-8e6d-4dcd60c0a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.572898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-23c07265-90ef-49b2-8e6d-4dcd60c0a320 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:26.573777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001ed3-8273-435a-844f-98af16d2fcb5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.574524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-23c07265-90ef-49b2-8e6d-4dcd60c0a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:26.613919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.614923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.615349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.615792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.652320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 90/178] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:26.653926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387339b1-852e-4c88-ae97-012110c75b9c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.654379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387339b1-852e-4c88-ae97-012110c75b9c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.654655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387339b1-852e-4c88-ae97-012110c75b9c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.655954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 91/179] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:26.660858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387339b1-852e-4c88-ae97-012110c75b9c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.699200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.700708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e96e0-e7de-4264-9a93-7ae1b5f2abdc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.757188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387339b1-852e-4c88-ae97-012110c75b9c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.789195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.789855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.790099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.790375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.791208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=fa9ac61b8632465586bee816b0404515) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:26.791515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:26.792999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:26.796811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 89/180] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:26.798699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa0a-2179-4fa2-9306-28b26e340b7a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.798988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa0a-2179-4fa2-9306-28b26e340b7a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.799264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610aa0a-2179-4fa2-9306-28b26e340b7a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.800572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 90/181] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:26.803790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7f6e-7ace-4714-bfee-8ddeed4369eb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.803790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7f6e-7ace-4714-bfee-8ddeed4369eb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.803790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7f6e-7ace-4714-bfee-8ddeed4369eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.804267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 92/182] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/role_assignments?user.id=fa9ac61b8632465586bee816b0404515&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:26.806126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.823968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-66dd7f6e-7ace-4714-bfee-8ddeed4369eb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:26.825125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-66dd7f6e-7ace-4714-bfee-8ddeed4369eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:26.898131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 91/183] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:26.899928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028766-87ff-442e-85be-1b16b487672e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.900416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028766-87ff-442e-85be-1b16b487672e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.900915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028766-87ff-442e-85be-1b16b487672e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.902471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 92/184] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:26.903401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95028766-87ff-442e-85be-1b16b487672e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:26.937244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea2a9b-f064-4e7b-a7f3-a6ea795d8bb6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:26.971287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:26.972178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.972457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.972730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:26.983802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aba03234-7d5d-48d3-a402-1d46791fdad6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:26.992809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:26.993741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:26.994511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 93/185] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:26.995631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:26.995758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:26.996418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.017999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:27.019228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:27.030258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95028766-87ff-442e-85be-1b16b487672e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.070047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.070939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.071215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.071487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] PATH_INFO: `/v3/projects/f7744e8658e34373ad54c4cb1315daf1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.072740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] RBAC: Authorizing `identity:get_project(project_id=f7744e8658e34373ad54c4cb1315daf1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.074292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d45748-d70c-40a6-8fd7-f681a79fe473 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.075973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 93/186] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:26 2022] GET /identity/v3/projects/f7744e8658e34373ad54c4cb1315daf1 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.077163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.077702 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.077702 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.090354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 94/187] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:27.091199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.095510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:27.096745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:27.163013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 94/188] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:27.164336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.184865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352c4eb-a4b9-4cec-801c-b560f2e6a3ad None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.219631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.220486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.220764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.221037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.230759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:27.238873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:27.239833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:27.240618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 95/189] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:27.241271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.263178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54e2d4-29ba-4e6a-9e4d-49d0d881c6ad None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.295649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.296356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.296633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.296905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.297734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:27.298034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.299724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.307404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 95/190] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.312559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.338608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f516-f743-4dbb-bbff-f487416993ef None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.373459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.374118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.374397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.374673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.375749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=f7744e8658e34373ad54c4cb1315daf1, user.id=b5cc0d3ae6204c1097ca734a1ae8b884) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:27.376066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.377538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.383258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 96/191] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/role_assignments?user.id=b5cc0d3ae6204c1097ca734a1ae8b884&scope.project.id=f7744e8658e34373ad54c4cb1315daf1&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.384043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.419886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabbdc-8bbb-414a-8262-c2d0821fcb72 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.456419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.457253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.457536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.457813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.470062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:27.478094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:27.479027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:27.479837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:27.484055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 96/192] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:27.485467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.494271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b8a20-2702-4591-bcc6-3cd8e18533d3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.528300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.529534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.529823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.530098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.533430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.534949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.541921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 97/193] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.541921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.608085 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb605-6f1f-4135-89c2-3c9929c7ddbf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.640678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00b550-ef74-4286-a8ce-25aaff2de832 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.649425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.650119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.650401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.650677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.651437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:27.651942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.653361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.662670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 97/194] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.662670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.673618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.674514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.674796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.675071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.688319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.689797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.691488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 98/195] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.692255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.763095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585894-d64d-410e-89c1-c0b74d34e4b9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.786265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18c5a2-1ca7-46fa-9797-72173c870a3d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.796450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.797106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.797665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.797665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.798713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:27.799018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.800792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.808919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 98/196] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.809697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.821143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.821834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.822118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.822395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.823122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.824626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.851101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 99/197] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:27 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:27.871967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.915653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a4eb-1377-475d-92f6-54f132211a9a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:27.951897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:27.952819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:27.953102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:27.953410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:27.954899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:27.956252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:27.958321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 99/198] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:27.958950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:27.966765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7ecc-d7d6-4f9d-8ca0-139302582416 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.005007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.005691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.006098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.006385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.065128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9fd6a-5fae-42b1-9784-d90098faf8e9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.077678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.079648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.099884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.100847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.101135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.101467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] PATH_INFO: `/v3/users/abb87641b5424bf88cb56717b5bfc475` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.102686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] RBAC: Authorizing `identity:get_user(user_id=abb87641b5424bf88cb56717b5bfc475)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.104190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.107930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 100/199] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/users/abb87641b5424bf88cb56717b5bfc475 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.107930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.182224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 100/200] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:28.183022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.217007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992267-98cb-438f-a17f-3ef3fea51619 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.250632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.251258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.251538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.251845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.283259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac2554-941e-4df7-a360-4092e4636f23 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.317604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.318281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.318558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.318832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.319434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.320965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.385774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.387261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.419399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 101/201] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:28.420200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.484800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 101/202] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:28.485671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.519077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164d06-d565-4786-9ce2-9d5bac5e0394 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.553171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.554054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.554332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.554600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.555839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.557311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.559033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 102/203] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.563994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.589297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f7a4-d0ce-474f-9f03-b56f8f7e9a33 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.625127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.626554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.627032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.627646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.629820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.632855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.634872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 102/204] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.635929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.661673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d34b-e82e-41bc-be54-cd4e2e967dc8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.695103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.696017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.696293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.696566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.697778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.699283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.701003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 103/205] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.701848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.742978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ee0a-87e5-44b9-a360-ecbce4dc2eaa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.777725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.778889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.779389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.779916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.781023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=22212696d1264478a174075537146003) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:28.781586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.783284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.789466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 103/206] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/role_assignments?user.id=22212696d1264478a174075537146003&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.792051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:28.803121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aafd2d-6d71-4204-a472-b2e041713510 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.847600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.848326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.848608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.848888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.849752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=22212696d1264478a174075537146003) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:28.850059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.851573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270e65b-a18a-4975-816f-f4e45c960edb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.871087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 104/207] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/role_assignments?user.id=22212696d1264478a174075537146003&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:28.948631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c2eff-5520-407d-8d79-01d7f1a3bc95 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:28.985732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:28.986421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:28.986699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:28.986971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:28.987878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, scope.project.id=6e94a4fd583b45929d69eee003a571fc, user.id=abb87641b5424bf88cb56717b5bfc475) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:28.988193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:28.989692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b072243-e529-4a15-905f-11e962db0321 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:28.996921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 104/208] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:28 2022] GET /identity/v3/role_assignments?user.id=abb87641b5424bf88cb56717b5bfc475&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:30.348574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7194-8e64-4acf-8922-d7a3a9eb87da None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.349099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7194-8e64-4acf-8922-d7a3a9eb87da None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.349175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7194-8e64-4acf-8922-d7a3a9eb87da None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.350510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 105/209] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:30.356101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.356489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.356683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.374307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:30.376227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:30.379844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920ce2-1672-43c4-b229-b402fd479eb3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.380358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920ce2-1672-43c4-b229-b402fd479eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.380831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920ce2-1672-43c4-b229-b402fd479eb3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.382399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 106/210] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:30.387430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.388122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.388600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.405391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:30.406983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:30.445549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 105/211] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:30.470532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:30.474163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 107/212] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:30.497273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:30.570667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe665-fded-4f93-bc4e-aa5f08665a40 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:30.596311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3394-2ad8-470a-8062-89a48aef284a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:30.606449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:30.607586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.607985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.608268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.609566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:30.611740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:30.613413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 106/213] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:30.618872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:30.633430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:30.634608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.635087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.635558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.646206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:30.654433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:30.655329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:30.656170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:30.663627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 108/214] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:30.664740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:30.723627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9568-edee-4b96-bc6a-8fbde2bbe581 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:30.758948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:30.759602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.759912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.760190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.760916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:30.762370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:30.768054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02997b6-0d82-40ff-8211-5e978092dfc5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:30.789486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 107/215] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:30 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:23:30.808035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:30.809178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.809688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.810245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:30.811259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:30.811843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:30.813638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:30.827754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 109/216] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:30.831282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:30.958095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec97c62-1203-43dc-837f-439d95bfb008 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:30.994263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:30.995501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:30.996033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:30.996529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] PATH_INFO: `/v3/users/59c07c6a4c6445f79a9b237617e5dd36` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.010872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] RBAC: Authorizing `identity:get_user(user_id=59c07c6a4c6445f79a9b237617e5dd36)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.012712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7bb13-d914-4e08-b35f-b2e7a3fd97b1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.014607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 108/217] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:30 2022] GET /identity/v3/users/59c07c6a4c6445f79a9b237617e5dd36 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:31.020223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.135540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad97f-82ac-4ca5-8819-84158aeb3374 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.170003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.170678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.170961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.171246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.245536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.245536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.251108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443814-32c3-4f17-a59e-c7afcf9067ac None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.251391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443814-32c3-4f17-a59e-c7afcf9067ac None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.251666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443814-32c3-4f17-a59e-c7afcf9067ac None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.253483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 109/218] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:31.261153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb70f-4a7a-4791-9505-d0a5177ff7fa None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.261524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb70f-4a7a-4791-9505-d0a5177ff7fa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.261711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb70f-4a7a-4791-9505-d0a5177ff7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.283049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ba2bb70f-4a7a-4791-9505-d0a5177ff7fa None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:31.284620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ba2bb70f-4a7a-4791-9505-d0a5177ff7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:31.350515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 110/219] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:31.356250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2503-9125-4a1b-b228-a1da594fe456 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.357180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2503-9125-4a1b-b228-a1da594fe456 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.357652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2503-9125-4a1b-b228-a1da594fe456 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.359291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 111/220] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:31.364024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 110/221] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:31.365621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.366106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.366575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.369379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.397350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:31.398853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:31.466167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 112/222] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 12 14:23:31.467341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.474074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46ff6-10f9-43bb-9c7a-3cefbfa418fb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.524527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.525353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.525630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.525903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.528597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.530221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.532298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 111/223] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:31.533071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.570008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d2514-ea31-480c-8e63-8f64494a5cd0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.604219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.605400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.605873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.606335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.617324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:31.625796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:31.626637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:31.627404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:31.629832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 113/224] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:31.635405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.651823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58421-56b9-4861-bedf-ccffcc9281fb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.690411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.691244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.691530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.691860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.702303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:31.710746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:31.711629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:31.712545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 112/225] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:31.713189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.739679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621eac3-3f14-4ca6-9dca-06a2116caaaa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.774035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.775179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.775656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.776160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.777192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=59c07c6a4c6445f79a9b237617e5dd36) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:31.777715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.779371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.786614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 114/226] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/role_assignments?user.id=59c07c6a4c6445f79a9b237617e5dd36&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:31.787277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.845487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e3aba-a064-4d32-bbe7-2e12782bd5ee None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.883130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.884226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.884704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.885193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.886149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:31.886662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.888287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.894070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2bef-be91-475c-b3a3-1ff93f887936 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:31.898041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 113/227] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:31.903913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:31.930447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:31.931134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:31.931431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:31.931731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:31.932557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:31.932834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:31.934241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:31.943587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 115/228] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:31.952762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:32.068696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ee35-ba2b-4cb9-84ae-5b3913f75f58 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.121506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.122600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.122988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.123362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.124960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.126615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.129100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e0ee-e49c-4292-b81f-241620608dc0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.129348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 114/229] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:32.136778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:32.215478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.216272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.216558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.216837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.218166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.220414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.228449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 116/230] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:31 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:32.233542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:32.251882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373d6-8707-4109-8330-1cbbbfdd6193 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.304906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.306046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.306467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.306880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.308239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.309859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.312041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 115/231] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:32 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:32.317912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:32.405415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccce57-c34e-4381-9c87-d7d2beb7f5d1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.421159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798116c8-d76f-4de9-a940-452454aa7c96 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.439813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.440667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.440948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.441223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.442455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.444037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.446115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 117/232] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:32 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:32.456621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:32.471743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.473091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.473502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.473948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/22212696d1264478a174075537146003/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.476728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, user_id=22212696d1264478a174075537146003, role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.478398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d4aea-2370-4155-8543-47adec66cc14 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.518323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 116/233] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:32 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/22212696d1264478a174075537146003/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:23:32.560970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3984b-e393-4770-9261-d980430ec867 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:32.596248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:32.597359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:32.597735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:32.598104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/22212696d1264478a174075537146003/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:32.600357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, user_id=22212696d1264478a174075537146003, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:32.601971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f347f-dbbf-49fd-838f-4b7bedcd8c2d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:32.618939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 118/234] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:32 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/22212696d1264478a174075537146003/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:33.598608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694e98-51a1-49f3-9c1a-6fcc749d390d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:33.599152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694e98-51a1-49f3-9c1a-6fcc749d390d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:33.599452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694e98-51a1-49f3-9c1a-6fcc749d390d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:33.601282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 117/235] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:33.606645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:33.607075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:33.607387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:33.625919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:33.627097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:33.700078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 119/236] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:33.729151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d694e98-51a1-49f3-9c1a-6fcc749d390d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:33.843212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d694e98-51a1-49f3-9c1a-6fcc749d390d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:33.874213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:33.874957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:33.875330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:33.875605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:33.876844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:33.878343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946976c-c730-4b4f-a94a-c80c5e81596f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:33.880114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 118/237] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:33.885997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:33.987522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442dc10-d177-4b6a-a927-6da442a318b2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:33.990943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b916-655a-4c06-864c-42781c639b11 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:33.991235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b916-655a-4c06-864c-42781c639b11 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:33.991506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b916-655a-4c06-864c-42781c639b11 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:33.992959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 119/238] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:34.006273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.006594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.006821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.038829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:34.040090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:34.077403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.078115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.078446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.078721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.079453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:34.080990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:34.123494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 120/239] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:33 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:34.137168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 120/240] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:34.174476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.315005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510678-8e06-4c32-bc97-19a0b686175c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:34.352218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.353088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.353365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.353684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.366078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:34.373994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:34.375309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:34.376396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 121/241] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:34.382102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.486648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe26d8-6619-4ac9-9f35-3aa6f306a009 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:34.521668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.522361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.522642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.522916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.523823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:34.524132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:34.525584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b82c3-8cd6-438b-b4ad-4fe5266427da None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:34.539800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 121/242] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:34.541573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.570180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9043-bc52-4e32-9b78-b17b66d02298 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.570727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9043-bc52-4e32-9b78-b17b66d02298 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.571006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9043-bc52-4e32-9b78-b17b66d02298 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.572993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 122/243] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:34.579006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.579356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.579640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.598810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:34.600041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:34.652573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd97e1-0a2e-45d6-8277-18eb498108ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:34.671780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 123/244] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:34.689297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.690263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.690548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.690826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] PATH_INFO: `/v3/users/2cc00b032d5e45d8b897783a1376a2c8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.693302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.717368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc00b032d5e45d8b897783a1376a2c8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:34.719724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:34.721804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 122/245] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/users/2cc00b032d5e45d8b897783a1376a2c8 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:34.727986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.827203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66028fbe-858c-4325-84fd-adf0a17e479e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:34.846998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d575-6516-427d-a28f-65d528103be9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:34.864888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.865715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.865999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.866274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.878235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:34.885642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:34.886281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.886556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:34.886651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:34.887441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:34.888274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:34.888860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.888925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 124/246] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:34.895487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:34.963637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:34.965177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.009548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a93420-1e9f-4001-8641-0f751f52977f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.045629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.046329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.046613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.046895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.048746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:35.049061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.050481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.060156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 125/247] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:35.073621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 123/248] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:35.079866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.080108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.197950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed493ba-9284-4343-8142-13b606f82706 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.205522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feea8-592c-4d59-825f-b7236f5d9930 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.243887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.245417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.245913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.246406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] PATH_INFO: `/v3/users/59c07c6a4c6445f79a9b237617e5dd36` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.248097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] RBAC: Authorizing `identity:get_user(user_id=59c07c6a4c6445f79a9b237617e5dd36)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.250512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.253428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 124/249] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/users/59c07c6a4c6445f79a9b237617e5dd36 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:35.262670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.284265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.285233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.285511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.285784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.291716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.291716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.292047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 126/250] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:35.298863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.398304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2bdb-3880-49f0-bf74-a69e45bf3de8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.450289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.452552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.453986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.455804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.458173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.460504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91263189-1552-4d4e-812b-c964bde46e38 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.462804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0d24-ff91-40c7-a9a0-35c9dfc1ae42 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.464845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 125/251] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:35.467901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a75b-d128-4448-9d6c-5b8d43e3454e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.475210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a75b-d128-4448-9d6c-5b8d43e3454e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.475834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a75b-d128-4448-9d6c-5b8d43e3454e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.477562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 126/252] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:35.478468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a75b-d128-4448-9d6c-5b8d43e3454e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.511837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.512512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.512802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.513080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.513928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=2cc00b032d5e45d8b897783a1376a2c8) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:35.514243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.515821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368484d7-6fd0-41ab-8efa-cf8a5866ce56 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.522389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 127/253] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/role_assignments?user.id=2cc00b032d5e45d8b897783a1376a2c8&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:35.523844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b4168-a7a9-45eb-958f-59cc69e7bed5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.524229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b4168-a7a9-45eb-958f-59cc69e7bed5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.524519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b4168-a7a9-45eb-958f-59cc69e7bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.543596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3a4b4168-a7a9-45eb-958f-59cc69e7bed5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:35.544991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3a4b4168-a7a9-45eb-958f-59cc69e7bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:35.610658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a75b-d128-4448-9d6c-5b8d43e3454e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.628090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 128/254] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:35.630213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998239-aca1-40cd-98fe-c05f7b83ede3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.630706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998239-aca1-40cd-98fe-c05f7b83ede3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.631177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998239-aca1-40cd-98fe-c05f7b83ede3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.632809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 129/255] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:35.638672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.639266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.639772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.649562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.650467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.650750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.651025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/59c07c6a4c6445f79a9b237617e5dd36/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.653244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, user_id=59c07c6a4c6445f79a9b237617e5dd36, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:35.654906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:35.662380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:35.667732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:35.679955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 127/256] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:35 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/59c07c6a4c6445f79a9b237617e5dd36/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:35.681128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.741916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 130/257] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:35.770098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.803767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e98c-04e8-408c-acc7-cb33a0c8bd0a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:35.846131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:35.847279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:35.847870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:35.848310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:35.873147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:35.885063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:35.886064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:35.886850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:35.894724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 128/258] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:35.900787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:35.963624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a669a4-46a4-4a78-9f83-1f3dd8028de6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.036374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.037958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.037958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.038153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.054273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:36.064067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07104b-2db7-4bdd-a402-a140aa5a10fe None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:36.064820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:36.065683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:36.066471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 131/259] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:36.073167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:36.115836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.117110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.117591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.118236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.119678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:36.120290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.122024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:36.136075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 129/260] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:36.142520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:36.240016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb685c9-92b2-4e51-9de5-ef2e754afd62 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.335245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.335975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.336259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.336516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.337305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:36.337929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.372378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:36.384029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1cd0-54d4-4b3a-b04d-c7221fb0ac56 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.399041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 132/261] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:36.415896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:36.481686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.482626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.482908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.483180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.484633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.486343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:36.488527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 130/262] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:36 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:36.496811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:36.570229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201a4a-a939-4d07-9376-7af0781e67f3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.619088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.621642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.622669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.624097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] PATH_INFO: `/v3/users/22212696d1264478a174075537146003` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.626511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] RBAC: Authorizing `identity:get_user(user_id=22212696d1264478a174075537146003)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.628587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:36.631213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 133/263] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:36 2022] GET /identity/v3/users/22212696d1264478a174075537146003 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:36.638682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:36.674667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e96044-ce79-460f-aaf9-a0fb1c41c919 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.777249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c85a5-7e93-4272-9a66-375fbde549e0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:36.778859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.779540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.779860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.780141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.823742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:36.823893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.825812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.825812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.916109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.917626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:36.964849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:36.966389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:37.046145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 134/264] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:37.052811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:37.246616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 131/265] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:37.265066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63425eb1-6925-47c1-b7f7-29ecaff4c5b8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:37.270614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:37.322223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:37.324911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.326322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.326860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:37.330256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:37.334984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:37.344126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 135/266] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:37 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:37.348688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:37.409448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0affe5-1f25-4fc5-b838-8da498d64350 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:37.443863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:37.445084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.445555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.446037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:37.447497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:37.449206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:37.451398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 132/267] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:37 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:37.457249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:37.592857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38189a-0356-4e7f-aa30-9724ddc02f42 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:37.606051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdb839-220d-4c85-b5b5-f776e7c760f6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:37.630958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:37.632001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.632471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.632946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:37.633989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=22212696d1264478a174075537146003) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:37.634500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:37.636172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfef-278f-4694-a975-eab83b0428ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:37.642754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 133/268] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:37 2022] GET /identity/v3/role_assignments?user.id=22212696d1264478a174075537146003&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:37.659460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:37.660171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.660614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.661029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:37.662013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=22212696d1264478a174075537146003) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:37.662466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:37.664185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d245c48-71bf-43eb-8f85-043ec12d7ac0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:37.671251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 136/269] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:37 2022] GET /identity/v3/role_assignments?user.id=22212696d1264478a174075537146003&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:37.982966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e99d-560d-4ba3-b9b4-9534c2f31101 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.983981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e99d-560d-4ba3-b9b4-9534c2f31101 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.984519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e99d-560d-4ba3-b9b4-9534c2f31101 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:37.986146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 134/270] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:37.991916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:37.992511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:37.992973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.014919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:38.016678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:38.098019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 137/271] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:38.121868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e99d-560d-4ba3-b9b4-9534c2f31101 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.226818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e99d-560d-4ba3-b9b4-9534c2f31101 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.260957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.261731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.262009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.262280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.272649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:38.280551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:38.281634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:38.282621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 135/272] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:38.287766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.427104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fa0c-5b5c-4281-ac04-64847338bb96 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.471004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.472145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.472626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.473099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.474053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:38.474554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:38.476200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc683af-dbb8-4c60-bf8b-f23093391987 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:38.486204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 138/273] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:38.491428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.512149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e8-0942-40bb-af26-5308a309b206 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.512424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e8-0942-40bb-af26-5308a309b206 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.512631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf382e8-0942-40bb-af26-5308a309b206 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.514267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 139/274] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:38.519680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c518-d041-4479-976d-bb2867857afe None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.520000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c518-d041-4479-976d-bb2867857afe None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.520278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c518-d041-4479-976d-bb2867857afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.537477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e092c518-d041-4479-976d-bb2867857afe None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:38.538661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e092c518-d041-4479-976d-bb2867857afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:38.594359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f0d52-fe40-4c00-a3f9-247c4ede8163 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.615786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 140/275] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:38.632008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c518-d041-4479-976d-bb2867857afe None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.633495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.634528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.634809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.635091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] PATH_INFO: `/v3/users/04fc4065ef744aef825466f0cbffa9e0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.649447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=04fc4065ef744aef825466f0cbffa9e0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:38.650929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:38.657521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 136/276] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:38 2022] GET /identity/v3/users/04fc4065ef744aef825466f0cbffa9e0 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:38.658502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.733278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c518-d041-4479-976d-bb2867857afe None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.755656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc926fa-c949-4f62-acb2-f9932b9ae5c3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.768406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.769531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.770008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.770473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.771932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:38.773637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:38.775831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 141/277] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:38.781738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:38.801639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.802971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.803413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.803964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.805760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, user.id=04fc4065ef744aef825466f0cbffa9e0, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:38.806279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:38.808620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a34cbd-aaea-4210-be8d-94470048c5ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:38.823287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 137/278] 10.222.0.79 () {56 vars in 1308 bytes} [Thu May 12 14:23:38 2022] GET /identity/v3/role_assignments?user.id=04fc4065ef744aef825466f0cbffa9e0&scope.system=all&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:38.913721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f409e-1577-44dd-96c4-8c21998ad8a7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:38.951644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:38.952801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.953559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.954300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.955324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:38.957036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecdddd-0a8c-4079-87df-7bf9bd753d2c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:38.980629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 142/279] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:23:38 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:23:38.984432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072632-232e-4092-9aa7-7679d3aabeda None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.986491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072632-232e-4092-9aa7-7679d3aabeda None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.986841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6241-e224-4f29-a2c6-b0a6a811e09c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.987185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4072632-232e-4092-9aa7-7679d3aabeda None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.987286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6241-e224-4f29-a2c6-b0a6a811e09c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.987479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6241-e224-4f29-a2c6-b0a6a811e09c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.989010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 143/280] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:38.989670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 138/281] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:38.995443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.995768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.996055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:38.996552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:38.997012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:38.997460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.015812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:39.016056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:39.017460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:39.017747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:39.105198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 144/282] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:39.120568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 139/283] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:39.128850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.144568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.270490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc225-9f20-4b07-b64c-ca2e439583e9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.270967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e9cf0-060c-4f52-8a07-154144e3fd2a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.315932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.316163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.316766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.317043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.317316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.317858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.318341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.318805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.328293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:39.332446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:39.336392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:39.337370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:39.338143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:39.339133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 140/284] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:39.343714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:39.344740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:39.345569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 145/285] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:39.346209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.352074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.466121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20bcb-942c-4311-bc20-a53fb207f7c0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.471994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeccb8-8b52-41a2-b4d1-488bed1fc47b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.505742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.506817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.507292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.507787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.508733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:39.509232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:39.510864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:39.520073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 141/286] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:39.526686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.543996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.545069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.545609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.546081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.547145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:39.547682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:39.549705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:39.566673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 146/287] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:39.576760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.666212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373ea8-01e0-402f-a5da-91875aebbaed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.713046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.714220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.714374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.714542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] PATH_INFO: `/v3/users/59c07c6a4c6445f79a9b237617e5dd36` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.720756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] RBAC: Authorizing `identity:get_user(user_id=59c07c6a4c6445f79a9b237617e5dd36)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:39.722290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:39.724658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 142/288] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/users/59c07c6a4c6445f79a9b237617e5dd36 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:39.729966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.768583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b9b0-37c3-4961-9443-7ec47e3e8fdf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.820526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.822317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.822317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.822482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] PATH_INFO: `/v3/users/2cc00b032d5e45d8b897783a1376a2c8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.827744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc00b032d5e45d8b897783a1376a2c8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:39.827744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:39.827744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 147/289] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/users/2cc00b032d5e45d8b897783a1376a2c8 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:39.832979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:39.879304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1778b-492d-4e4c-bb3b-986788cb1514 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:39.918166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:39.919507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:39.920040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:39.920537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:39.999445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.003036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.058096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b6fe-20d2-4ae1-8fda-59a3b23a1e75 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:40.137972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:40.138874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.139153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.139428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.140886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.142329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.144232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 148/291] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:40.144373 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 143/291] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:40.149999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:40.152692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:40.265778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018d3e-356e-4489-a5d9-faa3f532c769 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:40.306637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:40.307793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.309311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.309745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.312005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.314513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.318755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 144/292] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:40 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:40.325052 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:40.403263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76393-e3b8-4c07-b9e5-f3b37c9968fd None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:40.444162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195acb6a-21f4-4ec0-b753-c6212fa0f8a5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:40.486096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:40.486764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.487044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.487317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.488188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=59c07c6a4c6445f79a9b237617e5dd36) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:40.488502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.490016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa90a5e-c2d1-4fd2-9b8a-d7c484ffbcf7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.494267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:40.495199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.495478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.495785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/2cc00b032d5e45d8b897783a1376a2c8/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.497946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, user_id=2cc00b032d5e45d8b897783a1376a2c8, role_id=4abd7a66f4dc49e28eb7fc18cd3d1d11)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.499475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680f6f1-1538-4cf0-b1aa-bd90071245a7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.508747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 145/293] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:40 2022] GET /identity/v3/role_assignments?user.id=59c07c6a4c6445f79a9b237617e5dd36&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:40.526247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 149/294] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:23:40 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/users/2cc00b032d5e45d8b897783a1376a2c8/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:41.391791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10abc-72ae-4ad7-b7c0-bb8ba7b1abdd None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.392816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10abc-72ae-4ad7-b7c0-bb8ba7b1abdd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.393323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10abc-72ae-4ad7-b7c0-bb8ba7b1abdd None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.394968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 146/295] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:41.400905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.401788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.402260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.419732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:41.421274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:41.488472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 150/296] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:41.511001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10abc-72ae-4ad7-b7c0-bb8ba7b1abdd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:41.621353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10abc-72ae-4ad7-b7c0-bb8ba7b1abdd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:41.658146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:41.658933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.659217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.659490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.669782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8eaec960-7ba6-4e9a-b2ca-ab2ae3425ecd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:41.677993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:41.678855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:41.680086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 147/297] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:41.685055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:41.728928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a42-26af-45a8-a4bf-1a61c96defd6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.729270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a42-26af-45a8-a4bf-1a61c96defd6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.729470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6a42-26af-45a8-a4bf-1a61c96defd6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.731092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 148/298] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:41.736282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b45-2a8b-4650-a01d-fcb2603bc54d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.736567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b45-2a8b-4650-a01d-fcb2603bc54d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.736845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373b45-2a8b-4650-a01d-fcb2603bc54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.753489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-92373b45-2a8b-4650-a01d-fcb2603bc54d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:41.754669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-92373b45-2a8b-4650-a01d-fcb2603bc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:41.787073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88a9b9-2de5-407d-827c-9643582d0c1a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:41.823509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 149/299] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:41.828956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:41.829705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.830090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516206-d21c-4bee-a943-9c3734c2c830 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.830304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.830565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516206-d21c-4bee-a943-9c3734c2c830 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.830879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.831063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516206-d21c-4bee-a943-9c3734c2c830 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.831965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:41.832409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:41.836806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 150/300] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:41.836931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:41.839468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.839792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.840072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.850300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 151/301] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:41.856190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:41.861595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:41.862762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:41.927431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 151/302] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:41.928694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:41.961586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb167098-e3cc-4008-86fb-ad187c74b9d2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:41.995365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:41.996220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:41.996483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:41.996756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:41.997928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:41.999387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.001248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 152/303] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:42.001871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.031473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327c4f-599a-433f-a9c6-2bdd0475abd5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.064168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.065310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.065592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.065867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] PATH_INFO: `/v3/users/04fc4065ef744aef825466f0cbffa9e0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.067107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] RBAC: Authorizing `identity:get_user(user_id=04fc4065ef744aef825466f0cbffa9e0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.068594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.070382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 152/304] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:41 2022] GET /identity/v3/users/04fc4065ef744aef825466f0cbffa9e0 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:42.075385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.098414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b5507-ece7-4353-8247-9d89a5339c3c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.132927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.133730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.134014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.134286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.144107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:42.151657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:42.152558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:42.153370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 153/305] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:42.154027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.178735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eea63-b85c-4f41-9bd9-f8c3a4c5567e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.212920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.213226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.213510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] PATH_INFO: `/v3/groups` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.214203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.215642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.231636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 153/306] 10.222.0.79 () {60 vars in 1134 bytes} [Thu May 12 14:23:42 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:23:42.232565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.262652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eade22-f7fe-4d01-8c4e-4b6de9d29279 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.309095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.310011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.310299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.310581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] PATH_INFO: `/v3/system/users/04fc4065ef744aef825466f0cbffa9e0/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.312446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=04fc4065ef744aef825466f0cbffa9e0, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.313893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.331721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 154/307] 10.222.0.79 () {58 vars in 1334 bytes} [Thu May 12 14:23:42 2022] PUT /identity/v3/system/users/04fc4065ef744aef825466f0cbffa9e0/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:42.387715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef8655-1d3a-48bf-a438-4bd02dbeb2e2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.429355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.429957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.430246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.430521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.431299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:42.431613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.433086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.443216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 154/308] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:42.448895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.570584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836977b8-8864-4b1d-a97e-d04c20f0b4c2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.607006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.607965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.608246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.608521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] PATH_INFO: `/v3/users/915ad26d0fbc4df9aad33f96ee575345` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.623946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] RBAC: Authorizing `identity:get_user(user_id=915ad26d0fbc4df9aad33f96ee575345)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.626938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f1c50-f4d6-453d-a3bb-624a3a620aef None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.629399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 155/309] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:42 2022] GET /identity/v3/users/915ad26d0fbc4df9aad33f96ee575345 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:42.635411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:42.744263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6385-6d25-471e-8a49-7661690fe45c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:42.784318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:42.785012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.785296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.785572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.786444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, user.id=915ad26d0fbc4df9aad33f96ee575345, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:42.786762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:42.788303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b558-939d-4b60-ac0d-b267cb0e28f3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:42.794678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 155/310] 10.222.0.79 () {56 vars in 1308 bytes} [Thu May 12 14:23:42 2022] GET /identity/v3/role_assignments?user.id=915ad26d0fbc4df9aad33f96ee575345&scope.system=all&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:42.959706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb578a-d38c-48c4-bc0e-6a2db3cf3b19 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.960079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb578a-d38c-48c4-bc0e-6a2db3cf3b19 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.960279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb578a-d38c-48c4-bc0e-6a2db3cf3b19 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.961757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 156/311] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:42.967795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.968103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.968352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.986408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:42.987603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:43.055552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 156/312] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:43.078608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb578a-d38c-48c4-bc0e-6a2db3cf3b19 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.181630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb578a-d38c-48c4-bc0e-6a2db3cf3b19 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:43.218134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:43.219148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:43.219148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:43.219667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:43.229944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:43.237803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:43.238676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:43.239489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 157/313] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:43.247057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.347539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba066-49ed-4c7e-85c4-d20cfff95d55 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:43.381263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:43.381949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:43.382277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:43.382548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:43.383349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:43.383660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:43.385072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:43.393451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 157/314] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:43.398953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.506105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025481a-2994-4055-bdc1-615e8b490974 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:43.540905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:43.541810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:43.542092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:43.542368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] PATH_INFO: `/v3/users/2cc00b032d5e45d8b897783a1376a2c8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:43.543804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] RBAC: Authorizing `identity:get_user(user_id=2cc00b032d5e45d8b897783a1376a2c8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:43.545291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:43.548534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 158/315] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/users/2cc00b032d5e45d8b897783a1376a2c8 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:43.554014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.657752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a1d0-8c9b-49b2-8195-283313c75bc3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:43.692681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:43.693702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:43.694177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:43.694643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:43.760634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:43.762467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:43.860136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 158/316] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:43.865492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.971351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e0583-17ea-49b1-a487-0d7ed28c288f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:44.006995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:44.008286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.008768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.009239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.010661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:44.012386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829249e-d56b-4fc4-b986-b5ee6c10d11e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:44.014613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 159/317] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:44.020422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:44.118361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98225d4-29f4-4bb7-bf6c-12cbbe7117c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:44.151575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:44.152273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.152553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.152827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.153657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0, user.id=2cc00b032d5e45d8b897783a1376a2c8) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:44.153968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:44.155425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeabc91-97b0-44e2-a7df-ee491fc605f5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:44.161993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 159/318] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:23:44 2022] GET /identity/v3/role_assignments?user.id=2cc00b032d5e45d8b897783a1376a2c8&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:44.582456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a644dd-0d94-4f60-97b6-cc5ed8ef134a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.582456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a644dd-0d94-4f60-97b6-cc5ed8ef134a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.582456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a644dd-0d94-4f60-97b6-cc5ed8ef134a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.583565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 160/319] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:44.593278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f31b7-f065-4709-9254-89d1b1bddff0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.593812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f31b7-f065-4709-9254-89d1b1bddff0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.594013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f31b7-f065-4709-9254-89d1b1bddff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.613290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-959f31b7-f065-4709-9254-89d1b1bddff0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:44.614533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-959f31b7-f065-4709-9254-89d1b1bddff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:44.691534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 160/320] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:44.715654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a644dd-0d94-4f60-97b6-cc5ed8ef134a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:44.800479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c54bc-b643-4a89-b644-828beede73e6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.801108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c54bc-b643-4a89-b644-828beede73e6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.801608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c54bc-b643-4a89-b644-828beede73e6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.803752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 161/321] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:44.809227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.809781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.810316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.830739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a644dd-0d94-4f60-97b6-cc5ed8ef134a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:44.832537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:44.833657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:44.870367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:44.871199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:44.871486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:44.871804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:44.873046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:44.874528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:44.876759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 161/322] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:44.882479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:44.914325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 162/323] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:44.939612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:44.986792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce506b-17cb-4893-9c8a-dc91408512be None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.029820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.030540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.030855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.031147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] PATH_INFO: `/v3/groups` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.032450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.033922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bfdf3-3cb9-4e6a-b819-2daf9384ac78 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.039280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d384-e7a9-4223-a918-d8baaea0a8ee None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.054784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 162/324] 10.222.0.79 () {60 vars in 1134 bytes} [Thu May 12 14:23:44 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:23:45.057299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147a99-8ca5-4d1d-adfb-afeac9ff93df None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.057618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147a99-8ca5-4d1d-adfb-afeac9ff93df None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.057901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147a99-8ca5-4d1d-adfb-afeac9ff93df None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.059219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 163/325] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:45.065695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.066039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.066357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.078077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.079593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.079917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.080201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.084867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:45.086040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:45.091924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:45.100756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:45.101919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:45.102921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 163/326] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:45.108038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.163415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 164/327] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:45.187108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.221288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9008-c042-4e67-8cb4-f151b7869267 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.262324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.262682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.262945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.263223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.264002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:45.264327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.265942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.282422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 164/328] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:45.283385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.295759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8d556-8a2e-426f-a781-e4704023cc75 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.337731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.338481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.338758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.339030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.351026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:45.358943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:45.360084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:45.361072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 165/329] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:45.366235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.401392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c7fd-b919-4011-b22d-2067ec898938 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.441222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.442426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.442712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.442990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] PATH_INFO: `/v3/users/04fc4065ef744aef825466f0cbffa9e0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.444389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] RBAC: Authorizing `identity:get_user(user_id=04fc4065ef744aef825466f0cbffa9e0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.445850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.447725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 165/330] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/users/04fc4065ef744aef825466f0cbffa9e0 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:45.456358 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.485802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d505-efb2-454d-aeea-abdf32e29ef3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.530064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.530848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.531257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.531552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.532381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:45.532693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.534749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.546483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 166/331] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:45.553616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.590990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9f99-ea6d-4311-b533-f32a9d657225 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.628315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.629033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.629314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.629593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.630450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] RBAC: Adding query filter params (role.id=0aa03b4dadae4241965d05deeadb2759, user.id=04fc4065ef744aef825466f0cbffa9e0, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:45.630762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.632367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.646606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 166/332] 10.222.0.79 () {56 vars in 1308 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/role_assignments?user.id=04fc4065ef744aef825466f0cbffa9e0&scope.system=all&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:45.684836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b3ee-0ec5-42f9-8691-ceec273e3491 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.724374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.725320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.725600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.725936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] PATH_INFO: `/v3/users/915ad26d0fbc4df9aad33f96ee575345` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.727243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] RBAC: Authorizing `identity:get_user(user_id=915ad26d0fbc4df9aad33f96ee575345)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.728835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130398-7c8a-4bad-aaa0-e81fd438b116 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.730930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 167/333] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/users/915ad26d0fbc4df9aad33f96ee575345 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:45.740932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.880867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e205-a1c7-46ce-acaf-3d831bab42bb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.921078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.922098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.922331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.922613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] PATH_INFO: `/v3/system/users/915ad26d0fbc4df9aad33f96ee575345/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.924574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=915ad26d0fbc4df9aad33f96ee575345, role_id=4abd7a66f4dc49e28eb7fc18cd3d1d11)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.926018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d319c-bc78-4536-a439-03ebcbe24aa4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.938054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 167/334] 10.222.0.79 () {58 vars in 1334 bytes} [Thu May 12 14:23:45 2022] PUT /identity/v3/system/users/915ad26d0fbc4df9aad33f96ee575345/roles/4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:47.764514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9159-6e81-4545-8efd-21c5b77c3c1e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:47.765678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9159-6e81-4545-8efd-21c5b77c3c1e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:47.766182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9159-6e81-4545-8efd-21c5b77c3c1e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:47.768120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 168/335] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:47.775218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:47.776198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:47.776681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:47.800755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:47.802297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:47.894134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 168/336] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:47.918860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9159-6e81-4545-8efd-21c5b77c3c1e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.026513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9159-6e81-4545-8efd-21c5b77c3c1e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.064989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.065842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.066121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.066392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.079016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:48.087341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:48.088245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:48.089471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 169/337] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:48.095417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.198156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdae04e-53bb-4b2d-851b-7fb9f7cbd70d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.235089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127250-f506-420d-bef9-d453262c58fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.235809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127250-f506-420d-bef9-d453262c58fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.236090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127250-f506-420d-bef9-d453262c58fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.236367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127250-f506-420d-bef9-d453262c58fb None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.237132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127250-f506-420d-bef9-d453262c58fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:48.237437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127250-f506-420d-bef9-d453262c58fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.238827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127250-f506-420d-bef9-d453262c58fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.247391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 169/338] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:48.253218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.356452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7dd7-cfe9-41b6-ba80-276775852455 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.392903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.393570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.393847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.394120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.467108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.468671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.505524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4d5-c4d5-47d2-aed3-cad8f6fee46b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.505897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4d5-c4d5-47d2-aed3-cad8f6fee46b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.506054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4d5-c4d5-47d2-aed3-cad8f6fee46b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.507436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 170/339] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:23:48.516576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86670-91fc-43e0-bf27-a695fb71d275 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.517172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86670-91fc-43e0-bf27-a695fb71d275 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.517680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86670-91fc-43e0-bf27-a695fb71d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.557490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a6f86670-91fc-43e0-bf27-a695fb71d275 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:48.559010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a6f86670-91fc-43e0-bf27-a695fb71d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:48.579026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 170/340] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:48.584991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.695951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260865f-2b56-475f-b881-6f617f9bbc4f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.728797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 171/341] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:48.730667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e92b-717f-4e55-a7af-373936aafa9c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.731156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e92b-717f-4e55-a7af-373936aafa9c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.731642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e92b-717f-4e55-a7af-373936aafa9c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.733549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.733819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 172/342] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:48.734451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.734876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.735175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.739672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.740235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.740504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.740924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.742021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.743814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 171/343] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:48.759286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.768791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:48.770391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:48.881983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be4f9b-3b78-4501-b41b-1298d016bed1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.914493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 173/344] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:48.916162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.921214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.922447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.923376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.923880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.932539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.934926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.937601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 172/345] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:48.944206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.062542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22c1c-72b5-40be-a778-9c546299e9d8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.103410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.105457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.105953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.106451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.107524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=6e94a4fd583b45929d69eee003a571fc) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:49.108092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:49.110283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:49.116983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 173/346] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:49.118493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.172840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67b61-e248-4fa3-ad11-a4caf2fbad81 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.233773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.235280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.235839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.236294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.257767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:49.267636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbd751-2a62-485e-9a11-d61661713c40 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:49.271249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:49.272400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:49.273316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 174/347] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:49.300889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.328590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.329748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.330173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.330602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.354312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-497b57dc-e79a-4e27-bf6f-18814dbd8cb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:49.364755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:49.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:49.366964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:49.374633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 174/348] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:49.378516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728aa-e503-4bf1-b263-dad039558c87 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.379653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728aa-e503-4bf1-b263-dad039558c87 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.380112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402728aa-e503-4bf1-b263-dad039558c87 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.381635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 175/349] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:49.386959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402728aa-e503-4bf1-b263-dad039558c87 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.514423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d0c3-dd59-45ed-8cc2-eea3db24e4cb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.572586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402728aa-e503-4bf1-b263-dad039558c87 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.596559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.597653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.598085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.598506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.599438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:49.599934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:49.601546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144eefb-6dcc-4dd1-a0d8-9ad69d9aa074 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:49.611445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 175/350] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:49.613184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.613620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.614037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.618189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.619086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.619526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.619982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.620936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:49.621383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:49.622942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:49.633020 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 176/351] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:49.634102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.648848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:49.650074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:49.744043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab49f5-b399-471c-848a-34905d44ebe6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.745535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 176/352] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:49.746574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:49.780707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.781870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.782295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.782709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.855346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:49.857121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4ce61-761b-4fea-9044-8b40f90d1738 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:49.873831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d39ef2-1b17-4bf8-9862-c8e8bbcc9b4a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:49.917738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:49.917738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.917738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.918516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.980540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 177/353] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:49.982500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cbdf1-eb50-4933-9318-36af42d30d5f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:49.983223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cbdf1-eb50-4933-9318-36af42d30d5f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:49.983663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cbdf1-eb50-4933-9318-36af42d30d5f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:49.985770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 178/354] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:49.986919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cbdf1-eb50-4933-9318-36af42d30d5f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.015043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.017426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.119825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cbdf1-eb50-4933-9318-36af42d30d5f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.136805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 177/355] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:50.138146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.164465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.165615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.165903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.166238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.184737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ac3b65df-da0e-4690-b043-c3ab41d1f663 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:50.193736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:50.194822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:23:50.195661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:50.198763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 179/356] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:50.200646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.201228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.201729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.222691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:50.224382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:50.268478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e747-6fd8-4bc7-a7e9-fdaf4ef7d974 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.302813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 180/357] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:50.304227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.324279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.325375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.325765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.326226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.328463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.330070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.331996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 178/358] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.332892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.431015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa711e4-8486-43f1-9b46-e764dcbaf553 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.471130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa007-5b76-4a94-8fc8-7a58e2714121 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.475237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.476278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.476914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.476914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.478496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.480076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.481856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 181/359] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.482642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.512261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.512962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.513240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.513515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.514707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:50.514707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.516029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.525300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 179/360] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.527363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.616661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e92885-dff0-4176-96e8-a922a59e4f30 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.657108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457781-38a9-47e9-a267-39a1766f7b6c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.671878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.673777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.674133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.674479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.675922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.677484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279f2b4-b986-4df2-8caa-7a474cf21bea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.679173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 182/361] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.681635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a21f-06b4-4503-9abd-ccd9d04a8106 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.681871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a21f-06b4-4503-9abd-ccd9d04a8106 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.682151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a21f-06b4-4503-9abd-ccd9d04a8106 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.683551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 183/362] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:50.684256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a21f-06b4-4503-9abd-ccd9d04a8106 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.715622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.717507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.717862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.718213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.730761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:50.738624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:50.739591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:50.740596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 180/363] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:50.741298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.823111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a21f-06b4-4503-9abd-ccd9d04a8106 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.860627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa7a27-d1a2-4100-a577-4890d9b68ddd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.871519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.872496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.872775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.873107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.874341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.875895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.877608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 184/364] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.880238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.898739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.900013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.900442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.900887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] PATH_INFO: `/v3/users/915ad26d0fbc4df9aad33f96ee575345` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.902318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] RBAC: Authorizing `identity:get_user(user_id=915ad26d0fbc4df9aad33f96ee575345)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.903997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cee34d-03ea-4b36-b84c-b5e46c35201d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.905926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 181/365] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/users/915ad26d0fbc4df9aad33f96ee575345 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:50.907552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.908024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.908463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.926753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:50.928680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:51.008137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b302f92-9442-4867-900b-f471d5fe8cca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.023534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 182/366] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:51.024453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.057044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.058083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.058368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.059034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.059491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=6e94a4fd583b45929d69eee003a571fc) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:51.059851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.061316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.068434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 185/367] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:51.069372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.150563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7348a28-8daf-4bfa-a64f-65b5fa0aa415 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.192221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.193338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.193784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.194258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.195213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:51.195754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.197424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.198060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121621-c661-4ccb-ad8b-c17965eeef06 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.207583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 183/368] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:51.208936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.253274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.254360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.254848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.255327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.256435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:51.256954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.258669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.267176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 186/369] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:51.267917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.366720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c6a1-f46f-448e-8e3f-389230c26566 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.390711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b8015-cabc-402c-aef3-247f86b1b1a1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.403133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.403905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.404184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.404459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.405347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] RBAC: Adding query filter params (role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11, user.id=915ad26d0fbc4df9aad33f96ee575345, scope.system=all) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:51.405654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.407180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.420145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 184/370] 10.222.0.79 () {56 vars in 1308 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/role_assignments?user.id=915ad26d0fbc4df9aad33f96ee575345&scope.system=all&role.id=4abd7a66f4dc49e28eb7fc18cd3d1d11 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:51.421120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.429676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.430549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.430829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.431103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.457649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:51.473696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:51.474867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:51.475652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:51.477203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 187/371] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:51.486099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.680541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a6eca-d24e-4e5b-b4cf-018adf51da92 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.694992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c34ba-8075-47e0-8551-881e0aff55ce None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.753893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.754591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.754881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.755157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.762004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.762724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.763002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.763276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:51.764104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:51.764430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.766286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.785082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 188/372] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:51.813705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:51.913487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:51.916436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1fa48-537c-414c-8442-bd8b76d5afcf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:51.955163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cadd-7bcb-40cf-bb4c-ccd91f3c6de0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:51.994269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:51.994992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:51.995279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:51.995557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.077999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.079476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981b181-8fc9-4aed-8513-d0a41e20335f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.097781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 185/373] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:52.100480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256035f9-5cf1-4296-80c4-16fdd79a5f10 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.100997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256035f9-5cf1-4296-80c4-16fdd79a5f10 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.101486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256035f9-5cf1-4296-80c4-16fdd79a5f10 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.103206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 186/374] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:52.104520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256035f9-5cf1-4296-80c4-16fdd79a5f10 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.201407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 189/375] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:23:52.203323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.203853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.204356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.228782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:52.230078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:52.235666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256035f9-5cf1-4296-80c4-16fdd79a5f10 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.285656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.287640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.288364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.288981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.290588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.292999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.295829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 187/376] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.297026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.316036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 190/377] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:52.316972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.423471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa352-342d-4369-8f21-8d4bbc943c55 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.428474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09350af-a477-4b42-8930-9c7bc4092b37 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.465571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.466226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.466554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.466831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.468286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.471013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.472541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.472746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 191/378] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.473523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.474213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.474791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.475256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] PATH_INFO: `/v3/projects/da529673a2b348db8fa8b2ebc5773804` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.476787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] RBAC: Authorizing `identity:get_project(project_id=da529673a2b348db8fa8b2ebc5773804)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.478469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.480818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 188/379] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/projects/da529673a2b348db8fa8b2ebc5773804 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.491908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.595865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b91-8cc1-4d3f-8a0b-969e32eb0320 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.625977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0117-a261-47c7-9b7c-2c206b364224 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.633435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.634334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.634613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.634883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.646469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:52.655937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:52.656891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:52.658177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 192/380] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:52.659189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.671721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.671721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.671721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.671721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] PATH_INFO: `/v3/groups/19dd423330054302a0bb2ff03d452bd9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.690625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] RBAC: Authorizing `identity:get_group(group_id=19dd423330054302a0bb2ff03d452bd9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.692177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.694221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 189/381] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/groups/19dd423330054302a0bb2ff03d452bd9 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.695001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.785112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23536ef2-19ad-4220-8eae-20c14d3ee279 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.822773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4d1f-d31c-4e13-abd9-4fab09774b30 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.823084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.823084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.823084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.823084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.823717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:52.823717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.825027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.836126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 193/382] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.839137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.856523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:52.857271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.857556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.857833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.858602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:52.858893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:52.860438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:52.869694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 190/383] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:52.875452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:52.981476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722209b3-9b97-465e-96d3-7e20d5ad8c37 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:52.988545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d81b-6016-4693-bbb9-d68164a4bf79 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:53.015366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:53.016285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.016566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.016837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.018043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:53.019508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:53.021171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 191/384] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:53.026618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:53.045264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:53.045878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.046162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.046552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.047480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] RBAC: Adding query filter params (group.id=19dd423330054302a0bb2ff03d452bd9, role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=da529673a2b348db8fa8b2ebc5773804) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:53.047896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:53.049734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:53.060456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 194/385] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:52 2022] GET /identity/v3/role_assignments?group.id=19dd423330054302a0bb2ff03d452bd9&scope.project.id=da529673a2b348db8fa8b2ebc5773804&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:53.135644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad5c54-ba27-4cbc-beca-f68810ea62f9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:53.172065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:53.172979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.173602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.173879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.175180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:53.176702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7619d-bd17-4780-9f91-eea63e7ce597 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:53.178850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 192/386] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:53 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:53.184843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:53.295461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08a74-ba71-47f7-987b-5bb252453849 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:53.331980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:53.332909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.333188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.333464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.335785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, group_id=a8d1682d767c49a6b388c21d7c7634c1, role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:53.337308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553cc22-b82d-42f8-927b-a142d088f582 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:53.353676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 195/387] 10.222.0.79 () {58 vars in 1442 bytes} [Thu May 12 14:23:53 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:53.957656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa470f-23c4-4875-8dce-8b0c0b78546a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.958076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa470f-23c4-4875-8dce-8b0c0b78546a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.958262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa470f-23c4-4875-8dce-8b0c0b78546a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.959804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 193/388] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:53.965407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3351a-e0b2-48d6-9b0d-661961fa4bb9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.965707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3351a-e0b2-48d6-9b0d-661961fa4bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.966058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3351a-e0b2-48d6-9b0d-661961fa4bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.989063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-59d3351a-e0b2-48d6-9b0d-661961fa4bb9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:53.990629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-59d3351a-e0b2-48d6-9b0d-661961fa4bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:54.069731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 196/389] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:54.092012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa470f-23c4-4875-8dce-8b0c0b78546a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.095525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3b9e4-77f2-4573-9728-c38a9c81c75e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.095861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3b9e4-77f2-4573-9728-c38a9c81c75e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.096212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3b9e4-77f2-4573-9728-c38a9c81c75e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.098597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 197/390] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:54.103240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.103526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.103862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.121855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:54.122063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:54.190630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 198/391] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:54.213058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.216460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa470f-23c4-4875-8dce-8b0c0b78546a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.256630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.257865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.258337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.258824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.272360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:54.282724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:54.283655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:54.284500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:54.288185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 194/392] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:54.294363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.342265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b45cc-d1e1-43f2-a8f6-fb975e563fde None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.385697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.387231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.387950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.388443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.402070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:54.406249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566f26-a86a-4a6f-a182-0a01e2c58e27 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:54.412661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:54.413590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:54.414387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:54.417576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 199/393] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:54.426554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.454894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.456244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.456877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.457363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.458882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:54.459395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:54.461705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:54.472903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 195/394] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:54.480014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.557803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599c3f-2398-479a-8a55-a82a5a2073d0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.600664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.601363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.601638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.601954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.602750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:54.603061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:54.604549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:54.614238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b5bf-403f-484b-b3f7-8ea89775b808 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.615249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 200/395] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:54.622101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.658839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.659652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.660095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.660306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.661553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:54.663019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:54.665132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 196/396] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:54.670355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.800896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a00b-250d-49a8-87d3-edee15c6bebf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.850601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f746ddf-48c2-4e5f-8a30-edbd80a3cb86 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:54.882994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.886460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.887007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.887554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.889780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:54.892509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:54.894764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 201/397] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:54.898565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:54.898565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:54.898565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:54.898565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:54.899155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:54.900745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:54.901402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:54.902449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 197/398] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:54.908837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:55.041758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a720-acef-4fac-bb3e-172a8b26674d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:55.091781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:55.093059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.093869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.094434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.095981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:55.098513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:55.101260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 202/399] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:54 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:55.107648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:55.154027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8a7c1-eff2-4664-b90f-d7975e026238 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:55.227250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac3655-19e9-435e-96f2-4e0e9d315229 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:55.233882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:55.234981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.235269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.235548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.241099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e94a4fd583b45929d69eee003a571fc, group_id=a8d1682d767c49a6b388c21d7c7634c1, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:55.242590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05427c4b-13f5-4c48-b799-da61807087d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:55.269356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 198/400] 10.222.0.79 () {58 vars in 1442 bytes} [Thu May 12 14:23:54 2022] PUT /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:55.272344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:55.272344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.272344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.272344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.277510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, group_id=a8d1682d767c49a6b388c21d7c7634c1, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:55.279402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca2a7f-5a36-412e-8611-d96d89807935 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:55.297552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 203/401] 10.222.0.79 () {58 vars in 1442 bytes} [Thu May 12 14:23:55 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:23:55.801491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00c5-4679-4b7f-bc6e-ce6ff88e7db2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.802191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00c5-4679-4b7f-bc6e-ce6ff88e7db2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.802685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d00c5-4679-4b7f-bc6e-ce6ff88e7db2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.804657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 199/402] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:55.810273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d124-680d-431f-89fa-54276205e636 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d124-680d-431f-89fa-54276205e636 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.811312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540d124-680d-431f-89fa-54276205e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.829958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9540d124-680d-431f-89fa-54276205e636 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:55.831506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9540d124-680d-431f-89fa-54276205e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:55.926140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 204/403] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:55.968154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d00c5-4679-4b7f-bc6e-ce6ff88e7db2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.116453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d00c5-4679-4b7f-bc6e-ce6ff88e7db2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.158167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.159458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.159990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.160484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.173625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-10dc997d-7444-46c0-9166-d9853589f2ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:56.182526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:56.183497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:56.184354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:56.187253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 200/404] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:56.193539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540d124-680d-431f-89fa-54276205e636 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.320497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540d124-680d-431f-89fa-54276205e636 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.354754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3804-13c1-4199-a53d-b0a6034690f2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.355795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3804-13c1-4199-a53d-b0a6034690f2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.356295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3804-13c1-4199-a53d-b0a6034690f2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.358281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 201/405] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:56.362916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.362916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.362916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.362916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.363856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:56.364168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:56.365321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.365592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:56.366015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.366534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.375198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 205/406] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:56.384820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.389298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:56.390749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:56.484535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 202/407] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:56.527840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.545768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adef8c-cbb7-42e1-8321-1371f03cc1a8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.581126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.582363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.582867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.583332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.584742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:56.586485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:56.588623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 206/408] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:56 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:56.594213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.698077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb94cf1-3520-4f91-af3e-6d4709279e78 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.731943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479883-653d-42f1-8688-346387396730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.733209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479883-653d-42f1-8688-346387396730 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.733688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479883-653d-42f1-8688-346387396730 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.734246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479883-653d-42f1-8688-346387396730 None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.735771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479883-653d-42f1-8688-346387396730 None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:56.737453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479883-653d-42f1-8688-346387396730 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:56.739674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 207/409] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:56 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:56.743851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e6a0e-8922-4093-8f29-28730ec7245b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.745649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479883-653d-42f1-8688-346387396730 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.808587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.809424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.809725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.810048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.848720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:56.851168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479883-653d-42f1-8688-346387396730 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:56.856422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:56.857402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:23:56.858175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:56.864017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 203/410] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:56.864934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:56.889548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:56.891055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.891533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.892049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.894480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] RBAC: Authorizing `identity:create_grant(project_id=8cb23a1fe4da4399b5227bb43010f4d0, group_id=a8d1682d767c49a6b388c21d7c7634c1, role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:56.896171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d98b38-1979-4d26-a1b9-5ec2b80c6edf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:56.914237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 208/411] 10.222.0.79 () {58 vars in 1442 bytes} [Thu May 12 14:23:56 2022] PUT /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0/groups/a8d1682d767c49a6b388c21d7c7634c1/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:23:56.922984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9e18-1d64-4548-ba62-c724dc72139f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.923565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9e18-1d64-4548-ba62-c724dc72139f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.923808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9e18-1d64-4548-ba62-c724dc72139f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.928605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 209/412] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:56.933604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:56.933895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:56.934245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:56.955770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:56.956919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:57.034821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d050-394a-418a-94ff-7d802217258b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.071246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245223a7-1297-472c-8627-49d3458872aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.071972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245223a7-1297-472c-8627-49d3458872aa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.072255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245223a7-1297-472c-8627-49d3458872aa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.072527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245223a7-1297-472c-8627-49d3458872aa None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.073290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245223a7-1297-472c-8627-49d3458872aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:57.073598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245223a7-1297-472c-8627-49d3458872aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.074997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245223a7-1297-472c-8627-49d3458872aa None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.084634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 204/413] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:57.093024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 210/414] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:23:57.094510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245223a7-1297-472c-8627-49d3458872aa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.118102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.204438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245223a7-1297-472c-8627-49d3458872aa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.240070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.241074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.241457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.241836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] PATH_INFO: `/v3/groups/19dd423330054302a0bb2ff03d452bd9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.241999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0482a-f1cb-4244-8d75-6b52d4056dd2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.243292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] RBAC: Authorizing `identity:get_group(group_id=19dd423330054302a0bb2ff03d452bd9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.245377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.247050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 205/415] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/groups/19dd423330054302a0bb2ff03d452bd9 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:57.260838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.280384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.281733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.282316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.282786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.293781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:57.303262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:57.304222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:57.305056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:57.307897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 211/416] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:57.314795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.424682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ad09-2320-4853-b0bf-8c0fc9955479 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.463116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.464215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.465119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.465611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.466701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:57.467247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.468929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.478727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 212/417] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:57.485239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.507942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202b48-2b40-4a36-8414-934f292daf13 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.603229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.604145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.604425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.604702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] PATH_INFO: `/v3/projects/da529673a2b348db8fa8b2ebc5773804` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.605905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] RBAC: Authorizing `identity:get_project(project_id=da529673a2b348db8fa8b2ebc5773804)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.607372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.608733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834416d-fd80-4199-97f2-a65594948228 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.616112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 206/418] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/projects/da529673a2b348db8fa8b2ebc5773804 => generated 344 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:57.617059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:57.658349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.659419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.659958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.660442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.732780 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93534-6a47-4e07-916b-ca9cf147daa0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:57.766247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:57.767172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:57.767455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:57.767777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] PATH_INFO: `/v3/projects/da529673a2b348db8fa8b2ebc5773804/groups/19dd423330054302a0bb2ff03d452bd9/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:57.768772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.769707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] RBAC: Authorizing `identity:create_grant(project_id=da529673a2b348db8fa8b2ebc5773804, group_id=19dd423330054302a0bb2ff03d452bd9, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:57.774877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.775023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86290f-51c9-440e-aa21-2cb2bff8f1fc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:57.794133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 207/419] 10.222.0.79 () {58 vars in 1442 bytes} [Thu May 12 14:23:57 2022] PUT /identity/v3/projects/da529673a2b348db8fa8b2ebc5773804/groups/19dd423330054302a0bb2ff03d452bd9/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:23:57.890567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 213/420] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:57.896849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.035657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db300ff1-906f-4a35-a4c5-498a6d0f2160 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.082298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f4d78-2c73-4012-aea8-11e16b914997 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.082641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f4d78-2c73-4012-aea8-11e16b914997 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.082851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f4d78-2c73-4012-aea8-11e16b914997 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.084561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 214/421] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:58.087182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.088122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.088639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.088639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.089776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.089885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.090059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.090337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.091316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.093483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 208/422] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:57 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:58.099408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.111112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:58.112391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:58.203884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 215/423] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:58.226590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0357b-d1f8-4768-879a-73eab4e42874 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.249995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.281474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.282362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.282636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.282905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.284707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.286199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.295424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 209/424] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:58.297874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.403486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f5b6-cf1f-43a5-9bc9-72e540e9e83a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.425609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2412a3-381e-40b8-9456-bb7c0938f131 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.444298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.445195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.445484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.445750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.456530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:58.459912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.460588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.460873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.461155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.461994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=6e94a4fd583b45929d69eee003a571fc) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:58.462309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.463788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30e9dd-820c-4573-8e4d-9983d5b2f057 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-440f655c-59d2-4325-9ddd-062d1a6d691d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:58.464521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:58.465378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:23:58.466160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 216/425] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:23:58.468367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5bc9-0ea0-4460-a453-a6ee9e99a9d7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.468367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5bc9-0ea0-4460-a453-a6ee9e99a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.468367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5bc9-0ea0-4460-a453-a6ee9e99a9d7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.469645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 217/426] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:58.469820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 210/427] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:58.474683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5bc9-0ea0-4460-a453-a6ee9e99a9d7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.475383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645be06-68ce-44c1-927d-4d408726359e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.475676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645be06-68ce-44c1-927d-4d408726359e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.475987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645be06-68ce-44c1-927d-4d408726359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.493946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9645be06-68ce-44c1-927d-4d408726359e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:58.495189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9645be06-68ce-44c1-927d-4d408726359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:58.567966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 211/428] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:58.591851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645be06-68ce-44c1-927d-4d408726359e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.696851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645be06-68ce-44c1-927d-4d408726359e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.708802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5bc9-0ea0-4460-a453-a6ee9e99a9d7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.730888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.731740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.732030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.732307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.742958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:58.744368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.745198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.745539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.745873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.746844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:58.747213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.748739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:58.750936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:58.751841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:58.752646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 212/429] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:58.758106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.761086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 218/430] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:58.766357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.860508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7523-19a3-4abe-8a0e-f80c05b0e41a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.892321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedd8c-9350-4e5f-ac04-72cbca26acd3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.894797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.895516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.895827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.896112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.896882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] RBAC: Adding query filter params (name=member) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:58.897197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.898600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.908106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 213/431] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:58.913686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.932283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.933021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.933302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.933625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.009262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.010802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.019265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc25141-ecf3-4501-8203-4b5f8c486862 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.054807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.055492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.055801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.056078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.117488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 219/432] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:59.122914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.123293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.124908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.225106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987e37-a4bf-441b-a7a1-476d261072b0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.225539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 214/433] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:23:59.231209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.262071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.262966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.263246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.263517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.264749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.266252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.272776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 220/434] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:59.273692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.333099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9fe2-b792-4328-8707-a053236e96ca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.366913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.367874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.368101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.368375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] PATH_INFO: `/v3/projects/6e94a4fd583b45929d69eee003a571fc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.369576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] RBAC: Authorizing `identity:get_project(project_id=6e94a4fd583b45929d69eee003a571fc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.371018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.377620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 215/435] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/projects/6e94a4fd583b45929d69eee003a571fc => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:59.378484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.379823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abf8c8-ca4d-4868-85e6-9b6a4f250d8b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.416209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.417201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.417482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.417804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.419160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.420905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.428168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 221/436] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:59.429908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.484041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979eaa-d854-4bdb-aa49-0992f743beed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.519409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.520329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.520615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.520881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.522080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.523546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.530087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 216/437] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:59.531086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.532031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1edf85-9fd4-4680-9ad6-3e8bb4aee181 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.567640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.568412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.568692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.568968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.569819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:59.570127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.571606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4fbd9-b176-4112-9222-206f6bb9307e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.580473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 222/438] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:23:59.619182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba354-3cad-4342-b0a7-e1accce4a9b2 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.619839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba354-3cad-4342-b0a7-e1accce4a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.620320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba354-3cad-4342-b0a7-e1accce4a9b2 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.622252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 223/439] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:59.629822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.630453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.630952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.649544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8d1d-3d01-4c71-9470-df35d9787cdb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.651024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:59.652581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:59.686570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.687314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.687592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.687939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.688805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=0aa03b4dadae4241965d05deeadb2759, scope.project.id=6e94a4fd583b45929d69eee003a571fc) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:23:59.689125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:59.690604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:59.697190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 217/440] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=6e94a4fd583b45929d69eee003a571fc&role.id=0aa03b4dadae4241965d05deeadb2759 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:23:59.731818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 224/441] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:23:59.756561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:59.877525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027d032-dda4-4316-a270-ce5faaa3e82e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:59.914324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:59.915155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:59.915436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:59.915745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:59.926670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:23:59.935193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:23:59.936300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:23:59.937430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:23:59.939647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 218/442] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:23:59.945847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.049835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029395eb-b7ea-4ea3-8808-234de2e0165d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.084407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.085106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.085394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.085659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.086423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:00.086728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.088167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.097528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 225/443] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:23:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:00.103733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.217648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a0f2-c301-4af1-bb1a-b8d78728ec45 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.253498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.254187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.254463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.254734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.327270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.328974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894b137-b7de-4d6e-815f-8b6f5945a8e7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.432547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 219/444] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:00.438165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.452495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c237-0d2d-4077-bfd6-44b178fea7a5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.452850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c237-0d2d-4077-bfd6-44b178fea7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.453129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c237-0d2d-4077-bfd6-44b178fea7a5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.454521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 220/445] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:00.459843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.460195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.460466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.476801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:00.477912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:00.536620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97580be5-64e4-49eb-aebf-ecff8a9ceef1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.546138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 221/446] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:00.569186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.570043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.570347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.570614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] PATH_INFO: `/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.570768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.571837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] RBAC: Authorizing `identity:get_project(project_id=8cb23a1fe4da4399b5227bb43010f4d0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.573305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.574990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 226/447] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/projects/8cb23a1fe4da4399b5227bb43010f4d0 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:00.580521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.673476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58b4f3-7579-4c6d-9bfc-83264037e49a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.674642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37ac9-eddc-40a4-b38b-58fc8e7d094b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.705792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.706703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.706980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.707249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] PATH_INFO: `/v3/groups/a8d1682d767c49a6b388c21d7c7634c1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.708445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] RBAC: Authorizing `identity:get_group(group_id=a8d1682d767c49a6b388c21d7c7634c1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.709933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.710213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.711023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.711302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.711554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 227/448] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/groups/a8d1682d767c49a6b388c21d7c7634c1 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:00.711702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.717316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.722431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:00.730205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:00.731079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:00.731922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 222/449] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:00.737388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.819336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfa431-44b5-4c05-ba38-9a002dbf0078 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.839343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93188c-1928-4732-94ff-771c50213250 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.854347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.855033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.855321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.855593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.856465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] RBAC: Adding query filter params (group.id=a8d1682d767c49a6b388c21d7c7634c1, role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:00.856781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.858244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.864747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 228/450] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/role_assignments?group.id=a8d1682d767c49a6b388c21d7c7634c1&scope.project.id=8cb23a1fe4da4399b5227bb43010f4d0&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:00.879243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.879243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.879243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.879243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.879588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:00.879588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.879588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.885999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 223/451] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:00.892765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:01.005040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789829f8-1943-454f-849f-e9e8ea95cd38 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:01.042460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:01.043131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:01.043403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:01.043720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:01.113929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:01.115421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:01.217677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 229/452] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:01.223909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:01.335834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bfaf6-7d19-4860-be57-103c2373e3dc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:01.374585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:01.375447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:01.375735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:01.376031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] PATH_INFO: `/v3/projects/da529673a2b348db8fa8b2ebc5773804` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:01.377363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] RBAC: Authorizing `identity:get_project(project_id=da529673a2b348db8fa8b2ebc5773804)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:01.378799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:01.380725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 224/453] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:24:01 2022] GET /identity/v3/projects/da529673a2b348db8fa8b2ebc5773804 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:01.389879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:01.487642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b35e5b-1441-4b80-b2fb-b6f81b72489e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:01.521644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:01.522513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:01.522789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:01.523067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] PATH_INFO: `/v3/groups/19dd423330054302a0bb2ff03d452bd9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:01.524310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=19dd423330054302a0bb2ff03d452bd9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:01.525769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d3ba-49d5-4551-a5ca-510b2388a7a6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:01.527370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 230/454] 10.222.0.79 () {56 vars in 1180 bytes} [Thu May 12 14:24:01 2022] GET /identity/v3/groups/19dd423330054302a0bb2ff03d452bd9 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:01.534737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:01.634617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01bb1-fb30-4a51-b981-04855f02c47e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:01.668305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:01.669226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:01.669512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:01.669787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:01.670614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] RBAC: Adding query filter params (group.id=19dd423330054302a0bb2ff03d452bd9, role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=da529673a2b348db8fa8b2ebc5773804) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:01.670927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:01.672487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43a6db-ae88-4bb1-ac5f-49314fd54876 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:01.678605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 225/455] 10.222.0.79 () {56 vars in 1376 bytes} [Thu May 12 14:24:01 2022] GET /identity/v3/role_assignments?group.id=19dd423330054302a0bb2ff03d452bd9&scope.project.id=da529673a2b348db8fa8b2ebc5773804&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:04.351134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f30f-2e2b-48ae-ab06-8e1f825a2444 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.351747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f30f-2e2b-48ae-ab06-8e1f825a2444 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.351747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f30f-2e2b-48ae-ab06-8e1f825a2444 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.353378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 231/456] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:04.367312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb524b-b031-415a-a164-1ac06b366af3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.368129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb524b-b031-415a-a164-1ac06b366af3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.368542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb524b-b031-415a-a164-1ac06b366af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.392718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-49eb524b-b031-415a-a164-1ac06b366af3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:04.394146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49eb524b-b031-415a-a164-1ac06b366af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:04.477326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 226/457] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:04.524426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f30f-2e2b-48ae-ab06-8e1f825a2444 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:04.677471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f30f-2e2b-48ae-ab06-8e1f825a2444 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:04.708043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160cfc-4360-4d6c-8e8b-9c68b97892f9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.708566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160cfc-4360-4d6c-8e8b-9c68b97892f9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.708983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160cfc-4360-4d6c-8e8b-9c68b97892f9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.710763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 227/458] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:04.716415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07782c-080a-4d82-89da-695a6e6a476a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.716816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07782c-080a-4d82-89da-695a6e6a476a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.717319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07782c-080a-4d82-89da-695a6e6a476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.728673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:04.732740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.733313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.733802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.748311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:04.749988 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1b07782c-080a-4d82-89da-695a6e6a476a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:04.750367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:04.752330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1b07782c-080a-4d82-89da-695a6e6a476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:04.770313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:04.771266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:04.772170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:04.772170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:04.772170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:04.772170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:04.774508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 232/459] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:04.788342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:04.866433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 228/460] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:04.868291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724315-2fd2-466c-8897-e4073846f7c2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.868816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724315-2fd2-466c-8897-e4073846f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.869286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724315-2fd2-466c-8897-e4073846f7c2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.871068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 229/461] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:04.885486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.886158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.886638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.908397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:04.909947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:04.956840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82401-15ea-4eaa-8989-4fcc6b49415a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:04.991893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 230/462] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:04.993166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.008436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.009192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.009470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.009908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.010822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:05.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.012998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.033283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 233/463] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:05.034383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.099830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca91cdf-673e-45df-a9c7-530a6e4fb350 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.134785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.136003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.136483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.136952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.147649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.149063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f367d-0010-43b1-a497-c825ad51a853 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.149591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:05.167859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:05.168854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:05.169915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:05.169915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:05.169915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.169915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:05.174313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 231/464] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:05.175161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.185565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.186386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.186667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.186948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.199583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.201109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-599e03e8-0d17-4c04-a47e-a6f9a54d54c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:05.218400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:05.219321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:05.221023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:05.221023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:05.221023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.221023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:05.221023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 234/465] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:05.224018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104531e-dfb4-4aec-a42c-c5012f3e2cde None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.224301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104531e-dfb4-4aec-a42c-c5012f3e2cde None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.224597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104531e-dfb4-4aec-a42c-c5012f3e2cde None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.231432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 235/466] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:05.231432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104531e-dfb4-4aec-a42c-c5012f3e2cde None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.291628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76183f-cd18-4eee-aa50-75bb369765f3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.328444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.329356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.329567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.329815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.330526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.331997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.334043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104531e-dfb4-4aec-a42c-c5012f3e2cde None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.361738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 232/467] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:05.361738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.372626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.373403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.373684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.373957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.374754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:05.375062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.376870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb818-bce0-4b7f-9d54-a939565821a4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.391182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 236/468] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:05.392993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.393321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.393600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.412564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:05.413807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:05.475607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9c0ad-c63b-4d94-87ad-19b12407d05b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.488744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 237/469] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:05.489620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.538047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.538778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.539065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.539341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.540124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:05.540432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.541886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.561127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 233/470] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:05.562106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.600640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bfec9-7510-48f1-a30e-400c79d50323 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.653088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.654209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.654502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.654764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.655495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.657468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.683474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c520-fb27-4fb3-af87-d129d4fc3205 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.688464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 238/471] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:05.688464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.759030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.760251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.760748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.761225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.774478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.776414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:05.811027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:05.811978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:05.812812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:05.812812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:05.812812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:05.812812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:05.823113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 234/472] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:05.830844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.880516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327484-7fd2-4f08-9783-508668762eb0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.922170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.923760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.924372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.925252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.926444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.928694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97d6eb-7b05-4efb-bd26-ce94ff67f676 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.960933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 239/473] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:05.967985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f82fd-912e-43f1-9c45-02a8f38688aa None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.968790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f82fd-912e-43f1-9c45-02a8f38688aa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.969868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f82fd-912e-43f1-9c45-02a8f38688aa None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.976475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 240/474] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:05.979172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.979761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.980243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.995968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f97b4-967b-4909-9e0f-eb730627a3cf None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.002880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:06.004504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:06.048497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.049116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.049578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.049853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.050612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:06.050917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:06.052413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:06.068798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 235/475] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:06.073862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:06.096245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 241/476] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:06.125819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:06.190033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83d00-ac34-4b9c-8b3a-1a00bc3a18b5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.225607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.226642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.227146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.227633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.228581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:06.230227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:06.232986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59168-2698-4512-9ac2-ae1ccc0dd6b0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.258331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 236/477] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:06 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:24:06.276230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.276923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.277199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.277466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.278233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:06.279613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:06.287628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.sql.core [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:24:06.287628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 14:24:06.287628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [parameters: {'id': '6890be0c0ba14441a3e630795674b32e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 14:24:06.287628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80038) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 12 14:24:06.304641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return ref.to_dict() May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:24:06.305604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application yield resource May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise self.value May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application session.commit() May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:24:06.306811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.flush() May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application compat.raise_( May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:24:06.307938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:24:06.309009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:24:06.310002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [parameters: {'id': '6890be0c0ba14441a3e630795674b32e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:06.311189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 14:24:06.313340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:06.314607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 242/478] 10.222.0.79 () {60 vars in 1131 bytes} [Thu May 12 14:24:06 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:06.320341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:06.428881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362a5a-f28c-4589-bc68-4b9cea36f6ca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.463031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.463950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.464229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.464503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.475183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-397517e3-49c4-40c6-a788-7c258e590656 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:06.483554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:06.486116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:06.487288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 237/479] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:06.496891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:06.616833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fdd8-fe22-4018-a8d7-a09bac02e458 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.653256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.653953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.654233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.654513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.655278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:06.655594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:06.657097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4058f2-b241-4ced-ba4e-83f46c355ba1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:06.668414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 243/480] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:08.151628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58078-18fc-4908-a588-75447fa5aa51 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.152692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58078-18fc-4908-a588-75447fa5aa51 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.153173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58078-18fc-4908-a588-75447fa5aa51 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.155254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 238/481] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:08.161973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.162525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.162525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.188869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:08.190091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:08.264746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 244/482] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:08.305797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58078-18fc-4908-a588-75447fa5aa51 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:08.424491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58078-18fc-4908-a588-75447fa5aa51 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:08.466875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:08.467706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.467991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.468257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.485767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7e2bacf6-03f4-47ca-ae1c-488c44f1deea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:08.493558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:08.494416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:08.495627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 239/483] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:08.502773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:08.649547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a453f5-9519-4dc8-9fb6-379ce3c07e28 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:08.687828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cf83-e048-4373-9f93-9b2ac37d2659 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.688176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cf83-e048-4373-9f93-9b2ac37d2659 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.688362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cf83-e048-4373-9f93-9b2ac37d2659 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.690173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 240/484] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:08.690469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:08.691411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.691978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.692449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.693463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:08.693974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:08.696190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:08.696323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8eea-9070-4658-ad18-f2e47eb3f6de None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.696401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8eea-9070-4658-ad18-f2e47eb3f6de None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.696652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8eea-9070-4658-ad18-f2e47eb3f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.706021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 245/485] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:08.712002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:08.729305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e35e8eea-9070-4658-ad18-f2e47eb3f6de None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:08.730502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e35e8eea-9070-4658-ad18-f2e47eb3f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:08.812962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd481c-d6fa-483b-b0c1-bef99da326ea None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:08.848448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:08.849283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.849561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.849835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.861268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:08.862755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:08.886392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 241/486] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d291928c-cb67-4098-9eb7-8a22ecc9be19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:08.888026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:08.888841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:08.889696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:08.889696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:08.889696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:08.889696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:08.895717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b13c-56db-441a-b27c-93201f8307d2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.895717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b13c-56db-441a-b27c-93201f8307d2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.895717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7b13c-56db-441a-b27c-93201f8307d2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.895717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 242/488] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:08.896034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 246/488] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:08.897784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b13c-56db-441a-b27c-93201f8307d2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:08.898361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.898645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.898917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.923511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:08.924923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:09.023794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 247/489] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:09.024660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.036393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7b13c-56db-441a-b27c-93201f8307d2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.084271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.084953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.085236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.085510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.086243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:09.086550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.087977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.100166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 243/490] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:09.101002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.134562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baa124-e6e4-455f-937b-c7c4aa7c9b52 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.172484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.174139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.174139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.174443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.184816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:09.192676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:09.194747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 248/491] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:09.196824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.211879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922070c-60d9-4b2b-8880-721fbd7d888d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.246765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.247582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.247912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.248186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.258947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:09.267045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:09.269104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 244/492] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:09.271059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.300873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc785-7da4-4745-9394-433d2b17e215 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.339534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.340406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.340790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.341072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.349996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.351491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:09.367123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:09.369403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:09.372192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:09.373385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 249/493] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:09.373930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.383742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df777f5-1f09-4035-af33-668f4e4e4d3a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.418075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.418771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.419054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.419335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.420156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:09.420469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.421838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e78c-9461-4677-bc92-0d60e8d09d2d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 245/494] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a234f2-061f-441c-9f9d-a6396ac9ad46 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a234f2-061f-441c-9f9d-a6396ac9ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a234f2-061f-441c-9f9d-a6396ac9ad46 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 246/495] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:09.434800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a234f2-061f-441c-9f9d-a6396ac9ad46 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.481915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2506b-b145-4fdc-ae1d-ede34d3166ea None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.515740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.516482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.516905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.517181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.518076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:09.518380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.519805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.528030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 250/496] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:09.528810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.532588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a234f2-061f-441c-9f9d-a6396ac9ad46 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.565427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.566023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.566298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.566566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.567397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:09.567716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.569172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f516fa-f190-4b9f-89d4-7f5d8879b5d6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.604625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 247/497] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:09.605860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4373-4049-4e92-b0a2-a5bb0ee31633 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.606143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4373-4049-4e92-b0a2-a5bb0ee31633 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.606407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4373-4049-4e92-b0a2-a5bb0ee31633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.623571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b18c4373-4049-4e92-b0a2-a5bb0ee31633 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:09.624809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b18c4373-4049-4e92-b0a2-a5bb0ee31633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:09.626227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b00a-1544-428d-9556-e340e6e303cc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.658208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.659019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.659295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.659561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.669793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.671256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:09.688420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:09.689363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:09.694931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:09.694931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:09.694931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:09.694931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:09.695139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 248/498] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:09.695139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35eed-14be-4adf-92a7-e0250e14ebc6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.695302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 251/499] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:09.695370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35eed-14be-4adf-92a7-e0250e14ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.695370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c35eed-14be-4adf-92a7-e0250e14ebc6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.695485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.695557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 249/500] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:09.695557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c35eed-14be-4adf-92a7-e0250e14ebc6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.787204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c35eed-14be-4adf-92a7-e0250e14ebc6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.798359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb33e86-6989-4aed-9b4f-e110554d57d6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.823455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.824166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.824443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.824718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.831217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.832061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.832338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.832605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.843496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.845097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:09.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:09.862974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 252/501] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:09.868811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:09.892603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.894104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0339e-32b5-40f3-b33e-d61cd32f96dd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:09.960429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa74e-5c6f-47bd-928b-eb7c62f83bc2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:09.991569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:09.992253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.992756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.992890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 250/502] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:09.992970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.993499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:09.993825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:09.993944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:09.994077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:09.994361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:09.995167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.007210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 253/503] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.008031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.010316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:10.011948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:10.074409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 251/504] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:10.075193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.108123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a929cb-c646-4f05-b9fb-41ecee399cf7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.142808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.143627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.143939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.144215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.154212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:10.162487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.163380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:10.164234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 254/505] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.164896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.175469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d351-d9c5-498f-9008-b0a5b7274b46 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.208400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.209076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.209362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.209635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.210359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.210663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.212113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.223877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 252/506] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.224685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.270179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c562-d132-4723-a1cb-65918ecc5cb2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.302765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.303580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.303887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.304162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.314485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.315986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.324153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a7324-5b3e-4e80-a395-7c57947c2238 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:10.332516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.335446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 255/507] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.336346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.358562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.359363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.359641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.360205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.367709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.369178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:10.384320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.385296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 253/508] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.386268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.437878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540eee0-2202-4ef3-a9f2-19c3460dec60 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.472657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.473467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.473750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.474029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.483292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffea18-f907-4f2e-96c0-d991e750ec42 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.485756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.487280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:10.504712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.505572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 256/509] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.506789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.520226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.520891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.521172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.521433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.522182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.522484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.523897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.531606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 254/510] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.532482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.604560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ccd7-f35d-4c8e-a8c9-7beb7a963628 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.625775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ce15-83b8-421e-9d4e-fc054f8fa8c7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.637061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.637868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.638151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.638426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.646369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.647855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.658340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.659002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.659270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.659543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.660301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.660606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.661962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:10.662419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.663249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:10.664173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 257/511] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.664716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.679080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 255/512] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.679931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.775932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7eb27-6299-4784-9374-435ad612ae0c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.779923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573de92-8ca2-43d7-9ec2-c1e652d91af1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.809098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.809793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.810073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.810336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.811167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.811465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.812971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.814751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.815413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.816151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.816151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.816716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.817021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.818391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.829861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 256/513] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.830677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.854320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 258/514] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:10.855220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:10.928447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92846bd-1246-4f63-8c0e-a1fd45ba81c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.954012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cad2a8-9ae1-4e2b-a35b-0c6c641a5e09 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:10.962696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.963512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.963804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.964073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.974745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.976239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.988793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:10.989498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:10.989777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:10.990060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:10.990898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:10.991204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:10.992691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:10.992937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:10.993746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 257/515] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:10.999524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.010082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 259/516] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:11.011102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.090972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa880e2-c099-4462-a2a6-13a85955f9e2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.106426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82cdf-0800-41f2-870d-3ad822cf1ab5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.124788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.125614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.125993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.126265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.133050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.134513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.139242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.139940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.140218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.140489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.141176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.142642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:11.149069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:11.149987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:11.150817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 258/517] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:11.151283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.166596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 260/518] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:11 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:11.167411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.269427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e064a-23bd-4cf5-a988-d39479d7756a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.276151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192f4c-33ba-476c-ad3b-e8b7ea041a47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.306868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.307583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.307886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.308166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.312304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.313092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.313559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.313835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.314607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:11.314928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.316402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.334460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 261/519] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:11.334460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.381581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.383000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.448314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4fe61-8897-4fbe-9785-5c48828e764e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.482427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.483093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.483374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.483674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.489157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 259/520] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:11.489996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.555642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.557184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.585993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b150-5d4c-4495-988e-b4e5ad8e2db4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.619467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad415-8f63-4015-878b-36a89058739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.620165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad415-8f63-4015-878b-36a89058739c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.620452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad415-8f63-4015-878b-36a89058739c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.620729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad415-8f63-4015-878b-36a89058739c None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.621530 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad415-8f63-4015-878b-36a89058739c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:11.621840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad415-8f63-4015-878b-36a89058739c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.623278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad415-8f63-4015-878b-36a89058739c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.641246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 260/521] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:11.642675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad415-8f63-4015-878b-36a89058739c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.657219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 262/522] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:11.658697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.742828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad415-8f63-4015-878b-36a89058739c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.757134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be4f-0754-497b-ad40-36dc1c196ff8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.777556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.778440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.778745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.779064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.786747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.788235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.789900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.790720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.790991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.791247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.801853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.803315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:11.803415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:11.804295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:11.805194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 261/523] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:11.806442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:11.824176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:11.825259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:11.826359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:11.826359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:11.826359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:11.826359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:11.830027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 263/524] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:11.830926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.925037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387733f-5180-4d44-bc24-4caafdb79c30 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.939676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf34d8-8046-4afb-b436-54bdfb2e846b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:11.962016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.962694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.962969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.963419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:11.964097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:11.964403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:11.965849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:11.971669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 262/525] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:11.972549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:11.987399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:11.988365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:11.988718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:11.989065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.001762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.003429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:12.025602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:12.026530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:12.027394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:12.027394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:12.027394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:12.027394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:12.027394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 264/526] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:12.028625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.091586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958063-df97-4d8d-b572-4af402ffd5a3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.142806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.144396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.145341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.145963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.147116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:12.147797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.149831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.164174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35eb3d-688b-4bcd-bc61-c4e4a175eac2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.175145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 263/527] 10.222.0.79 () {56 vars in 1139 bytes} [Thu May 12 14:24:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:12.176607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.205826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.206515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.206798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.207076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.218152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:12.218152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.218152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.226490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 265/528] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:12.227397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.274951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555033d-f8df-40a2-9018-8fb389a4cfee None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.308547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.309227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.309504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.309773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.310511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:12.310815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.312283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.325150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 264/529] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:12.325920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.329165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac4-2527-4982-96ff-c74af555da4c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.365126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.365800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.366086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.366361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.424763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bcbcd-be75-4379-b6df-d04b1371f0b8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.435134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.436667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.461828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.463054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.463525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.464005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.471375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.473182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:12.487923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:12.488823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:12.489647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:12.492121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 265/530] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:12.493190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.542646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 266/531] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:12.543880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.597969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2f5e-5153-4042-add8-a72e091363ed None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.631894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.632714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.632975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.633255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.640216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.641828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:12.656428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:12.657276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:12.658122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:12.662503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 266/532] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:12.663394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.669029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bd20-113c-4826-8f60-5536ae1a92fa None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.716458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.717068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.717347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.717621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.718423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:12.719319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.720863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.744544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 267/533] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:12.745064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.775534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c43c3-6421-4475-8c2b-93ed1ad1aabc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.809936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.810816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.811114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.811383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.823912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.825490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:12.848325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:12.849286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:12.850139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:12.850139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:12.850139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:12.850139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:12.854697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 267/534] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:12.855676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.880199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a39a2-b162-4bf9-b1b4-7492f76d2f44 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:12.915198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:12.915824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:12.916178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:12.916528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:12.917395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:12.917770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:12.919468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:12.937398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 268/535] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:12.938724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:12.983398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d5e5-5c07-4ad8-8c5c-b16558cb50d2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.024263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.025569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.026282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.026735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.027924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=f11c04b2350b44c6a9dd95acf914fc69) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:13.028868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.030975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.038635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 268/536] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/role_assignments?user.id=f11c04b2350b44c6a9dd95acf914fc69&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:13.039901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.058756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3972ac-5cbf-4d66-bc2d-900f63acbdd1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.137645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.138473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.138822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.139172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.140012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:13.140404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.142069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.157637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e530d-732f-4472-a246-0a1d1148d4ae None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.169010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 269/537] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:13.175423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.197738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.199054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.199553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.200040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.201295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=acb6ff788d5841a3b627c60feaf44d56) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:13.201825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.204496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b16664-7f95-420d-bfc0-1554dd5d7653 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.212149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 269/538] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/role_assignments?user.id=acb6ff788d5841a3b627c60feaf44d56&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:13.352087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e62c-274b-4e9f-87cc-5870c356710f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.401216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.402063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.402350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.402629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.411602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.413168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:13.432444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:13.433357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:13.434194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 270/539] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:13.437263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251623-b618-4d8d-a214-249d2d26617b None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.437263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251623-b618-4d8d-a214-249d2d26617b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.439859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251623-b618-4d8d-a214-249d2d26617b None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.439859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 270/540] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:13.440151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.445671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.445957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.446229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.480432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:13.482321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:13.610580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 271/541] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:13.616558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279cb96-c52d-482b-bde4-da7fea0ac26a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.652851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.653910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.654851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.655323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.655814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.656861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:13.657366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.659072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.685731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 271/542] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:13.693926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.801257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9b24-0efb-4d18-b67e-27f7708ed205 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.814688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c8c29-cd9c-4a5a-a44c-872ff6772a29 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:13.845914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.846760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.847043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.847320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.858390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:13.858584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:13.859071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:13.859350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:13.859625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:13.860721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=cedef275f3404a3c8e618cb48f2afc16) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:13.860980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:13.862551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:13.867267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:13.868550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:13.869343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 272/543] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:13.875107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 272/544] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/role_assignments?user.id=cedef275f3404a3c8e618cb48f2afc16&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:13.876796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:13.987775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0daf-516e-4fd7-9199-e13ccfe0ec09 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.025246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.025945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.026227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.026502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.027279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:14.027587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:14.029057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:14.039541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 273/545] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:14.049429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.181982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2177f-79e6-4d9d-b69b-001d5fe3385d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.221120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.221959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.222236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.222505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.233390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:14.234914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:14.262075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:14.262970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:14.263857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:14.263857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:14.263857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:14.263857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:14.263857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 273/546] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:14.270147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.424122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c7bd-429f-4a1a-b6c2-73a650ba9e93 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.467499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.468274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.468432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.468660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.469772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:14.470511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:14.471951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aafa6-0c9d-47ab-8f87-a666f958ca97 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:14.488687 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 274/547] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:14.496840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.559100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb445f-3bc8-4530-86bb-42856c931ad9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.559770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb445f-3bc8-4530-86bb-42856c931ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.560253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb445f-3bc8-4530-86bb-42856c931ad9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.562268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 275/548] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:14.568270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.568550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.568833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.607918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db09d-ee11-4303-a949-c13fda7037bb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.608663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:14.609942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:14.646685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.647899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.648381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.648852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.668829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:14.670565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:14.692206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:14.693167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:14.694081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:14.703831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 274/549] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:14.705136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.706828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 276/550] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:14.743659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.895240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0b7ec-7b17-4b61-8d76-f6ae357ba1f5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.923321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962f15-a0dd-4dd3-8eda-dfe8c2b35414 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:14.945369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.946070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.946351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.946623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.947464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:14.947793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:14.949268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:14.975135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 275/551] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:14.975304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:14.976112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:14.976392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:14.976664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:14.981469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:14.987057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:14.994968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:14.995863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:14.996671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 277/552] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:15.002290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.107773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5e86-d71f-474b-a9a3-9049c2b82ca4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.144542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.145235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.145512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.145784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.151723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:15.151723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.151723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.157979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 278/553] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:15.163534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.203168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56593987-4144-489f-827f-7e62f9238de8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.270623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.271238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.271515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.271813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.352027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fda30-02cb-40b2-858a-aafe77448bf6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.387387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.388241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.388527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.388808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.401941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.403724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.408853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.410358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:15.426258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:15.427199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:15.428071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:15.428071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:15.428071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:15.428071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:15.428520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 279/554] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:15.434075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.549921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45adc9-99d7-4d43-b41c-5dfcadd57ea2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.587589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.588299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.588582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.589377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.590263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:15.590583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.592003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.606867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 280/555] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:15.614297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.647663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 276/556] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:24:15.655514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.748489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79babaa-a6e0-426a-a3d6-1fa2b28a13e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.786807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.787670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.787981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.788259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.796631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.798905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:15.815932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:15.816893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:15.817867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 281/557] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:15.826276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:15.875593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ff3e4-e5b1-4dad-b549-e16b299ea1df None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:15.914131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:15.916791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:15.918204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:15.918700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:15.946435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:15.952185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-51467ce5-79b3-40a6-90dc-46a8e8ca8c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:15.983137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:15.984060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:15.984946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:15.984946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:15.984946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:15.984946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:15.997562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 277/558] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:16.006200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be454d-15bd-4b18-8ce2-77c00b625130 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.009949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c96f3-3a89-49dd-b514-0c0125a57cd6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.009949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c96f3-3a89-49dd-b514-0c0125a57cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.009949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c96f3-3a89-49dd-b514-0c0125a57cd6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.011162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 278/559] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:16.014786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208232d5-3baf-47ce-890a-0dece9c62d45 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.014786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208232d5-3baf-47ce-890a-0dece9c62d45 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.014786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208232d5-3baf-47ce-890a-0dece9c62d45 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.014786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 279/560] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:16.014786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208232d5-3baf-47ce-890a-0dece9c62d45 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.045860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.046556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.046839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.047112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.048504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.048816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.050261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49aa9-efa5-4bff-b28f-6e6efe8c780b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.071862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 282/561] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.071862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb51b-523b-4f8d-96c8-e56bd7fa0713 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.071862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb51b-523b-4f8d-96c8-e56bd7fa0713 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.071862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb51b-523b-4f8d-96c8-e56bd7fa0713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.085635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0cffb51b-523b-4f8d-96c8-e56bd7fa0713 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:16.086823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0cffb51b-523b-4f8d-96c8-e56bd7fa0713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:16.123152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208232d5-3baf-47ce-890a-0dece9c62d45 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.154001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 283/562] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:16.155307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.155594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.155903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.169094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.170080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.170552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.171131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.171741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:16.172438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.173312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.173414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:16.175164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.188786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 280/563] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.192134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.241465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 284/564] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:16.242315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.299678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1b90-7c37-40c9-8868-e1cbe6864df6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.341621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.342448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.342728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.343249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.343407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2751-9e49-4b6b-bacf-febc1897a009 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.354056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.355540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:16.372528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:16.373583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:16.374485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:16.374485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:16.374485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:16.374485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:16.374485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 281/565] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:16.374753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.379217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.380114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.380391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.380662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.390955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:16.399272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:16.400422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:16.401413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 285/566] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:16.402094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.487848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7deaa3b-c32d-46aa-b918-6e8c9d7b7252 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.503928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46bbde-f912-4f50-b090-1139ccfce5e0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.521152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.521963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.522294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.522722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.530256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.531901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.536559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.537360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.537641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.537909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:16.545734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:16.546562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:16.547598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 282/567] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:16.549044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.549779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:16.557845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:16.564711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 286/568] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:16.566424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.646167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6328a-f2d7-4faa-9eea-280e599de627 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.654229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47852b-c2f1-403f-b72e-c5679076d566 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.679916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.680642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.680920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.681192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.681938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.682240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.683624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c97138-01f0-4a35-b642-21d3f7f53425 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.689457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.690181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.690453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.690723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.691469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.691804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.693252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.695046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 283/569] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.696376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521eb0e-c691-40ab-8efa-a2d613901fa0 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.696658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521eb0e-c691-40ab-8efa-a2d613901fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.696934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521eb0e-c691-40ab-8efa-a2d613901fa0 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.698144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 284/570] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:16.698832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521eb0e-c691-40ab-8efa-a2d613901fa0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.706367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 287/571] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.707182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.797150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521eb0e-c691-40ab-8efa-a2d613901fa0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.802788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b437c22-efa1-415c-8825-b355e6d685d7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.830579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.831251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.831527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.831830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.832617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.832926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.836744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.841055 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.841753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.842020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.842290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.843043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:16.843380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.844798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26053ba-e45d-485a-a638-3acc71397809 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.846685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 285/572] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.847481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.856911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 288/573] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:16.858139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.858422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.858693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.874990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:16.876206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:16.941476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12f46-d87f-4d22-ac75-b31c7f4af067 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:16.942972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 289/574] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:16.944158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:16.975057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:16.975922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:16.976203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:16.976494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:16.982960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:16.984449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:16.997755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:16.998656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:16.999526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 286/575] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.000049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.040922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd8e4e-9d8d-40c5-992d-1d6748893ffd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.075155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.075980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.076263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.076521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.086430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.087913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.098999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07d13-734d-49a9-ad70-cb099d4e8af5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:17.105464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:17.106367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:17.107260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:17.107260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:17.107260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:17.107260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:17.107260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 290/576] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.107542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.148757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.149427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.149719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.149991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.150864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=8771b05277f14efa9650690aae4587f6) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:17.151173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.152694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.158591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 287/577] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:16 2022] GET /identity/v3/role_assignments?user.id=8771b05277f14efa9650690aae4587f6&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:17.159182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.226313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1db-a274-4376-8405-5952c5e6d170 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.263016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.263884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.264167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.264444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.270950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7807-c454-4227-b822-1816c63c27e1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.277760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.279254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:17.298321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:17.299320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:17.300267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:17.300267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:17.300267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:17.300267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:17.304654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 291/578] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.305458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.307302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.308250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.308451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.308730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.321155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:17.329245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:17.330242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:17.331074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 288/579] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.333083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.405769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b33aa-18a1-4f96-906b-2b07f70cabf6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.432606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e536-6532-416d-82bc-d81d407afc6b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.439180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.439930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.440210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.440482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.441403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:17.441714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.443158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.459973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 292/580] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:17.459973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.467363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.468200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.468583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.468945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.469865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:17.470373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.472054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.489097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 289/581] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:17.489097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.557128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6047-44e4-4192-ac4a-0d27bde20939 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.586591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433df12-c6d0-4e54-be09-381a42dae2cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.588771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.589441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.589713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.590040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.590757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:17.591107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.592525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.608787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 293/582] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:17.608787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.626892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.627723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.628148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.628516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.629342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:17.629717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.631192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.639641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 290/583] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:17.640290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.710577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa02fe7-570d-4386-aaba-41d4f88075f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.739614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adfe2b-c3f6-4efe-89da-9eea733111f6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.744276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.745288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.745661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.745940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.761167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=e2801984340040c499b17ef6e0324033, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.762615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.773121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.774182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.774591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.774956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.783920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 294/584] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:17 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:17.783920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.784224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.785406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:17.811207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:17.812534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:17.813738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:17.820924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 291/585] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.822100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:17.909949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e9a8-57f4-4e4f-946a-6f85b273933c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.949277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:17.949809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:17.950088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:17.950362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:17.958526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:17.960032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:17.964695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22b4f-f490-4a7e-a87b-e82ff261db34 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:17.976484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:17.977535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:17.979105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:17.982191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 295/586] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:17.983179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.007827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.008703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.009082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.009453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.027917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.030238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:18.050079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:18.050994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:18.052332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:18.052332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:18.052332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.052332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:18.052332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 292/587] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:18.052605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.100654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8d63-42bd-489d-97aa-c9a0235d6f44 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.142261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.143535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.144174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.144619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.146170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.146673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.149011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.153487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be1eb9-b75b-4949-928c-f335dd80c4a8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.174800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 296/588] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.176324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.193019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.193864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.194253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.194623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.195542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.195953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.197560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.225313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 293/589] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.225313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.287791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1daa81-0dda-4717-b4ad-2632354c878a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.322301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.323285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.323797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.324262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.325177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.325700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.327288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.335240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf05c5-1ca9-4263-b866-e5f47b83eefe None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.344723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 297/590] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.346057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.369705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.370491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.370773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.371038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.383129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.384653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:18.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:18.403468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 294/591] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:18.404844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.447204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091f96c-baca-48b1-b03d-51b44f61e2fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.480836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.481811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.482185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.482551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.493630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.495200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.504683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cb5-dbca-46fe-a3aa-ab823605b201 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:18.512090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:18.513143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:18.514304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:18.514304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:18.514304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:18.514304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:18.520086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 298/592] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:18.521028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.539031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.539814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.540095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.540365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.548401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.549627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:18.564450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:18.565552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:18.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 295/593] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:18.567396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.625841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883399-b2a5-4adb-8b87-b9e67a7fc20d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.659276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.660179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.660558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.660927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.661781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.662179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.663671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.664503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cfbcb-1e4e-4144-8aa3-4af1311d935b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.676595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 299/594] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.677544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.699030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.699737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.700068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.700344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.701127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.701434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.702884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.715275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 296/595] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.716201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.782984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525624b3-2ad9-4b1f-8ffc-b0bf1e349032 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.821323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17816b3-463e-478b-89e6-699e3d8e7345 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.821787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.822419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.822788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.823149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.824134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:18.824549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.826109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.851921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 300/596] 10.222.0.79 () {56 vars in 1139 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:18.852944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.859739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.860757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.861038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.861313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.868612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:18.870194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:18.885092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:18.886202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 297/597] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:18.887417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:18.955426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb17a98-f36c-4696-97fb-c5e9bfafbf92 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.988129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd7484-a136-4362-9a84-91ff2b8bc10a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:18.989851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:18.990789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:18.991159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:18.991524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:18.998484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.000092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:19.013989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:19.015102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:19.016458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:19.022317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 301/598] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:19.023154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.023386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.024005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.024325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.024598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.035509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.037067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:19.056252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:19.058478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 298/599] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:19.060793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.127912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fff2-9c8d-44a0-a014-00fe97dda6fd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.160187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c8a0b-77c1-40d9-b507-67ab4462027b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.163101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.164643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.164927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.165205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.166004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:19.166312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.167769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.183741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 302/600] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:19.184885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.197627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.198323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.198665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.198952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.199880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:19.200198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.201707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.220452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 299/601] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:19.221347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.318083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151783-ac1a-4986-be87-876b4b3daaa5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.326189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1a65-3e60-4863-8535-2d1a2f92ade5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.359627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.360790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.361006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.361181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.361341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.361507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.361671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.361824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/f11c04b2350b44c6a9dd95acf914fc69/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.363788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:19.363788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.363788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.378256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=f11c04b2350b44c6a9dd95acf914fc69, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.379991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.381964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 303/602] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:19.383006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.397992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 300/603] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:19 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/f11c04b2350b44c6a9dd95acf914fc69/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:19.399192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.514976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d5c1-b0ed-4ed1-acbf-9eb1c26cb83f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.518030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771611a-e433-479c-890c-23c4dc422d67 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.553786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.554878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.555335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.555779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.560957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.561939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.562222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.562492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/acb6ff788d5841a3b627c60feaf44d56/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.565313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.567073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.580579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=acb6ff788d5841a3b627c60feaf44d56, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.582048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57df1-8f8c-4801-8538-bd57af4d6dd3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1317a3c2-70fa-45a4-8ddf-dc9e2a1e302e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:19.583307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:19.584382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:19.585349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:19.587434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 301/604] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:19.589167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bc3d-91e0-4e37-8800-50fbe6c0b471 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.589635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bc3d-91e0-4e37-8800-50fbe6c0b471 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.590101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bc3d-91e0-4e37-8800-50fbe6c0b471 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.591908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 302/605] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:19.594583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4bc3d-91e0-4e37-8800-50fbe6c0b471 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.605675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 304/606] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:19 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/acb6ff788d5841a3b627c60feaf44d56/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:19.606989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.607276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.607562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.633189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:19.634754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:19.724219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4bc3d-91e0-4e37-8800-50fbe6c0b471 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.726428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 305/607] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:19.748946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.761573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.762685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.763166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.763638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.764682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:19.765282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:19.767201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:19.781347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 303/608] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:19.786814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.853050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d720bc-b85e-4804-82a9-1e61aa2feaa6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.889078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.896035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.896035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.896035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:19.917943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:19.930645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:19.931638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:19.932526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 306/609] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:19.942642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:19.944573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80820-6bb0-44f6-be86-8023fe2fdf0f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:19.989162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:19.990333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:19.990618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:19.990894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/cedef275f3404a3c8e618cb48f2afc16/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.009649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=cedef275f3404a3c8e618cb48f2afc16, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:20.011271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:20.030693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 304/610] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:19 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/cedef275f3404a3c8e618cb48f2afc16/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:20.077492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f05e-3668-47af-82d6-9d6c66297d6d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.119445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:20.120181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.120461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.120734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.121628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:20.121935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:20.123468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2aab-af2c-401e-959e-7bf10a2fba38 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:20.133474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 307/611] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:20.138875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:20.304722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717784-8ac1-49b9-bde8-5ef9a14446b8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.365093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:20.365935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.366212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.366481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.382996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:20.384526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:20.402771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764562-a262-48dc-a1ed-514a4b1360f3 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.403049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764562-a262-48dc-a1ed-514a4b1360f3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.403325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764562-a262-48dc-a1ed-514a4b1360f3 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.405066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 308/612] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:20.410565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.410848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.411126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:20.414827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:20.415905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:20.416988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:20.416988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:20.416988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:20.416988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:20.418941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 305/613] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:20.428043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:20.433051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:20.434241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:20.502353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 309/614] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:20.525720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:20.633205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3985-8596-405b-b5ff-df4bbfd72db0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.653889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed61b7-a2c7-4a6f-b4d8-0b8480ae478f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.677692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:20.679401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.682432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.682817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.700576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:20.713181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:20.714390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:20.715449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:20.719726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:20.719726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.719726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.719726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.720113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:20.720113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:20.720772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:20.724477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 310/615] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:20.729040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:20.751505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 306/616] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:20.757863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:20.885803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82ec04-ac3a-4a62-b533-d3429cf5bc6f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.939545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e21ae-34c4-4bd4-970d-ad8e7b586a47 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:20.940562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:20.941286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:20.941568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:20.941871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:20.942712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:20.943024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:20.944434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:20.962248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 311/617] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:20.967899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.009012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.009831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.010113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.010389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.020667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.022135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:21.048429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:21.050613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:21.053040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 307/618] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:21.058640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.107849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f44-ea6a-41fe-b604-ef8ccae68df9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.153391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.154145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.154421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.154696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.179359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.180857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:21.208228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:21.210448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:21.212839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:21.212839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:21.212839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:21.212839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:21.212839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 312/619] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:21.224048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.271487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23454b-ee0b-41dd-90ca-1e3282261474 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.330687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.331380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.331666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.331963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.332811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:21.333121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.334706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.371037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 308/620] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:21.377715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.385992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121fdb9-af26-45b3-b24e-ef2d33fe36ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.446525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.447608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.447928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.448209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.448975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:21.449285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.450682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.475033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 313/621] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:21.480251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.577606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a614cc-6d43-44db-bfd8-9e0a37a864e7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.614768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2f0d7-31f7-4ea3-afb3-073cc272a1e2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.653547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.655530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.657126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.658009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.658512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.659529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.662146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.662657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.682756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.683920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.685634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.687292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:21.716480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:21.717441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:21.718467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:21.721964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 314/622] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:21.725344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:21.726235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:21.727152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:21.727152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:21.727152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:21.727152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:21.728659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.730645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 309/623] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:21.736533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.831664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b079-225c-4f6b-916c-bc29c095dacb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.852378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33638d-fdbe-4201-9d13-2f6ce2442a12 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:21.881025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.881736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.882022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.882303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.883177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:21.883502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.885011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.890201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:21.891205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:21.891756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:21.892252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:21.893197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:21.893719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:21.895492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:21.908469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 310/624] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:21.914948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:21.919101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 315/625] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:21.928884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.051110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b54be-e513-48c7-bfa2-90b38e16781f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.115148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.116004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.116286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.117848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.130266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2b4a-f326-42d7-a7d4-655c299d28de None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.134202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.135788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-db880a64-844a-40ba-b533-fbf7190472b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:22.158571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:22.159546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:22.160594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 311/626] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:22.161965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5c63-5268-4371-a0ce-24b63f5022ce None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.166568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5c63-5268-4371-a0ce-24b63f5022ce None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.166883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5c63-5268-4371-a0ce-24b63f5022ce None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.172334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 312/627] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:22.172334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5c63-5268-4371-a0ce-24b63f5022ce None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.188119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.189613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.190117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.190395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.271169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.273707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.291886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5c63-5268-4371-a0ce-24b63f5022ce None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.327705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.328568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.329560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.329851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.330659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:22.330972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.332514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bd54-2d38-40d4-99ce-1d39b5b88ada None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.350382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 313/628] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:22.350382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.350382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.350382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.367216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:22.368480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:22.401815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 316/629] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:22.402726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.442805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 314/630] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:22.444077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.508878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa52f2-15c5-4618-a0fa-18b7aebaff02 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.541916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.542818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.543097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.543369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/8771b05277f14efa9650690aae4587f6/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.553695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4bfe-83a9-48a0-b141-ddb865bf18a0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.558438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=8771b05277f14efa9650690aae4587f6, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.559916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26c4e0-72a8-4fde-ba54-fdba7333ca9e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.573063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 317/631] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:22 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/8771b05277f14efa9650690aae4587f6/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:22.574122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13504-3f68-4001-b7b1-adf2e521a93c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.574412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13504-3f68-4001-b7b1-adf2e521a93c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.574686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a13504-3f68-4001-b7b1-adf2e521a93c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.576196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 318/632] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:22.576727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13504-3f68-4001-b7b1-adf2e521a93c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.612228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.613085 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.613559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.613839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.631060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.632673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4576db55-3c19-48dd-9d91-6e7b8715668f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:22.652500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:22.653516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:22.654420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:22.654420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:22.654420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:22.654420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:22.654420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 315/633] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:22.657480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.657480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.657480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.676526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:22.677748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:22.718111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a13504-3f68-4001-b7b1-adf2e521a93c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.758589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.759542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.759915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.760382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.763873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 316/634] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:22.765137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.788031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:22.796563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:22.797772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:22.799169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:22.801055 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 319/635] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:22.801937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.877885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be17cc-bd4b-4775-8ec6-ffa2fbcccdaf None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.915148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f66ba-8590-4b90-81e3-57dbbef9cfad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:22.930433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.931096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.931378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.931644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.932408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:22.932709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:22.934088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c0c16-4918-4c23-a09e-194f6fe57eb1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:22.946739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 317/636] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:22.948121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12422e85-e3bf-40a0-9b6e-2632a99a8639 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.948404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12422e85-e3bf-40a0-9b6e-2632a99a8639 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.948675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12422e85-e3bf-40a0-9b6e-2632a99a8639 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.953431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 318/637] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:22.953431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12422e85-e3bf-40a0-9b6e-2632a99a8639 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:22.961884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:22.962716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:22.963024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:22.963272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:22.973604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:22.981638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:22.982590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:22.983420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 320/638] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:22.985858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.055531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12422e85-e3bf-40a0-9b6e-2632a99a8639 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.082554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0041-8c2c-47c2-95b2-2c51a3befbe7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.087673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.088381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.088659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.088930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.089674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.089975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.091349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64248f2e-53fe-4327-bbb8-ed9be4cb2051 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.104186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 319/639] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.105753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.106191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.106627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.117475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.118281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.118559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.118827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.125600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.126575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:23.127058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.128185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:23.141000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:23.142016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:23.142904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 321/640] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:23.143881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.201223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 320/641] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:23.201918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.261873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdedff-9635-4839-af87-c9bb9f87e884 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.295883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.296414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899dac2-fdc5-4784-9061-1aa2de9f93fa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.297223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.298535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.299492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.299842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.301262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.309999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 322/642] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.310817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.336895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.338444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.339151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.339612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.352937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.355114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:23.374153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:23.375277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:23.376695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:23.376695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:23.376695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:23.376695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:23.376695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 321/643] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:23.377016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.416185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554cef-361f-4849-ad93-e1fb10f830e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.449138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.449813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.450095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.450371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.451166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.451478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.452964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.465187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 323/644] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.466105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.481120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e6ed-b30b-492c-b51b-1d14cd178afd None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.515430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.516371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.516710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.517046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.527928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:23.535679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:23.536869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:23.537966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:23.543262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 322/645] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:23.544113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.576197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1c34-8c43-481c-ac3a-479b075df2f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.612519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.613330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.613609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.613874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.623467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.624934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.641846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06aea-e0f6-4896-b262-a835399ab645 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:23.642009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:23.643101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:23.644101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:23.644101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:23.644101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:23.644101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:23.644101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 324/646] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:23.644386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.680533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.681229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.681576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.681912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.682682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.682993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.684404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.702266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 323/647] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.702266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.742468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42837-40ce-49c3-800a-a201390b8ca6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.775676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.776528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.776874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.777145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.777977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.778293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.779812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.785465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 325/648] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.786327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.811393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3e96e-575a-4425-bdce-8722d1ba8375 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.858965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.860356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.860840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.861355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.862342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.862962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.864647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.874505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 324/649] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.875917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.896064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f820-1aa9-4d8f-8568-fd05a55e2472 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:23.931057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:23.931652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:23.931957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:23.932236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:23.932975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:23.933279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:23.934670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:23.952904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 326/650] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:23.954084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:23.999260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690b8b1-83e6-44c2-b35d-760f4387fece None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.039604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.040595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.040983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.041346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.049941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.051514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:24.066817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:24.068281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 325/651] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:24.069233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.085816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f034-6a55-43ca-8263-2d3e3ccea5e1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.124721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.125600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.125878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.126457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.138352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.140106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:24.163075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:24.164078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:24.164976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:24.164976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:24.164976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:24.164976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:24.164976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 327/652] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:24.165713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.196991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098606-0021-4763-9696-ad8ff9699c29 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.239898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.240738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.241016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.241446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.251810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.253619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:24.271968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:24.274128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:24.275345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 326/653] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:24.279003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.280454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95871-233d-4770-ac21-40b20162abc3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.320450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.321186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.321465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.321734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.322575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:24.322879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.324369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.343992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 328/654] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:24.344939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.385301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535517e-3c2b-499f-bf62-530cbf99acfc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.419543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.420433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.420819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.421196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.422071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:24.423558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.425083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.442404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 327/655] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:24.443573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.444268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d0c1-d259-475a-aa55-af381d8ace44 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.479065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.479667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.480011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.480284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.481179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:24.481482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.482960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.505748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 329/656] 10.222.0.79 () {56 vars in 1137 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:24.506709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.546015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ccaad-e871-4db1-9c29-4a912dfebd48 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.581547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.582386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.582783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.583157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.604960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5de1-5a08-43c8-a138-ed9ec6332704 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.638963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.639809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.640134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.640404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.648161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.649608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.650834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.652475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:24.665728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:24.666976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:24:24.668229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:24.672177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 330/657] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:24.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.763886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 328/658] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:24.764603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.773772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699d16-f836-4f83-9bd9-52090a9859d3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.807922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.808586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.808862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.809131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.865569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa148fc-8e05-4179-b8e6-f492aacab2be None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:24.884543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.886012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d797a40-0f19-4780-aea2-69361735ce65 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.901364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:24.902541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.903231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.903678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.904735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:24.905222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:24.907192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:24.924450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 329/659] 10.222.0.79 () {56 vars in 1139 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:24.925608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:24.987421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 331/660] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:24.989190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7afb-e738-4f09-8717-360cc1ce7d1e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:24.989472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7afb-e738-4f09-8717-360cc1ce7d1e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:24.989747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f7afb-e738-4f09-8717-360cc1ce7d1e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:24.991154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 332/661] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:24.992499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f7afb-e738-4f09-8717-360cc1ce7d1e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.027782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41337adb-b676-4bc0-b543-bad31fcaec22 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.061799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.062630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.062986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.063251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.074113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.075895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:25.094868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.096092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.097174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:25.097174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:25.097174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.097174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:25.099991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 330/662] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.100974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.101387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f7afb-e738-4f09-8717-360cc1ce7d1e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.134834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.135517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.135836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.136113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.200049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327c77-41fa-44dc-bb33-dc655384033f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.200957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.202420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.235781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.236594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.236871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.237142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.246983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.248474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-70fb3154-7a72-413d-9fbb-b83ddaa5a018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:25.265685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.266739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.267619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:25.267619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:25.267619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.267619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:25.267619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 331/663] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.268390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.268658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.269013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.284694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:25.285832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:25.306066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 333/664] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:25.306066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.351733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 332/665] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:25.351733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.404481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60131-2410-4a60-8740-57a02a5bb33c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.436234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.436900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.437186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.437449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.438445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:25.438553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.439869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.444832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a18a9f-0fd8-4e4a-b316-2fb691786f09 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.455282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 334/666] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:25.455282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.478363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.479037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.479317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.479594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.480366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:25.480669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.482045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.493405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 333/667] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:25.494208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.555941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713be07-2e25-4f50-87e6-07770ee8a2bc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.589019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.589847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.590469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.590469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.601137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.601719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739955e-7042-4b9f-be04-2b3d83062fab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.602717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:25.619623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.620572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 335/668] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.626553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.634325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.635150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.635437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.635736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.646218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:25.654105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.655101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:25.655996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 334/669] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.657323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.726755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc57ec5-da03-466f-83bb-114e9af51229 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.754687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b9d3-5d37-4832-972f-8926b4a9ecc9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.762907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.763725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.764032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.764295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.770961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.772473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:25.786685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.788083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 336/670] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.788979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.793238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.794074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.794352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.794621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.802923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.804400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:25.818822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:25.819764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 335/671] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:25.821318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.892776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4c90a-32d9-47b7-b670-60b04886c757 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.924060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f09d-6dbb-4130-97ef-4dff814e418a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:25.926944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.927620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.927932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.928204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.928924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:25.929227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.930607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.946493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 337/672] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:25.946493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:25.959057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:25.959776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:25.960045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:25.960318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:25.961070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:25.961373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:25.962753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:25.975072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 336/673] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:25.975072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.061960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f724-113a-44af-ac1b-521e7ed32fd9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.100411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.101284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.101432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65412cb-181b-4e6e-9ef9-164c5eaa8338 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.101880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.102095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.102994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.103394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.104927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.122863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 338/674] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.122863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.142618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.143376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.143661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.143988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.144762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.145081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.146525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.159205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 337/675] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.160096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.221767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3668-d83d-46e0-ae86-52ddb306aac3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.253691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.254498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.254775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.255047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.258198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce572-a910-4c9d-8298-ee5ea017e9dc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.261696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.263153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:26.276947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:26.277879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:26.278809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 339/676] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:26.280046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.291545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.292447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.292722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.293017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.303096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.304600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:26.321217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:26.322674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 338/677] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:26.324962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.382288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609546b-44ff-4e39-9497-9f022e6af750 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.417556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.418222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.418532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.418807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.419653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=f11c04b2350b44c6a9dd95acf914fc69) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.419997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.421452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dae13-1eb2-42ef-aa84-a8483db830af None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.428060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 340/678] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/role_assignments?user.id=f11c04b2350b44c6a9dd95acf914fc69&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.429368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d848b-bc33-42ca-98d3-a2b95bb31443 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.429667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d848b-bc33-42ca-98d3-a2b95bb31443 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.429948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d848b-bc33-42ca-98d3-a2b95bb31443 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.431341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 341/679] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:26.431457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf75a-4ca5-4d87-984f-9d90939ed2c4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.432036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d848b-bc33-42ca-98d3-a2b95bb31443 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.466999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.467712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.467984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.468256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.469212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=acb6ff788d5841a3b627c60feaf44d56) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.469522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.471100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.487452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 339/680] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/role_assignments?user.id=acb6ff788d5841a3b627c60feaf44d56&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.487452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.554956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d848b-bc33-42ca-98d3-a2b95bb31443 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.592074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.592770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.593048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.593320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.594381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.594879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.596423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed804d01-bdd4-421d-bc56-11a9be2f997e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.615380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 342/681] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.616318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ee1-74e9-48a9-8e80-631eab14d35b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.616931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.617215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.617488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.635651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:26.636815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:26.660748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.661449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.661732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.662013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.662765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.663073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.666864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.683247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 340/682] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.684298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.710760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 343/683] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:26.711639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.801368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a723f-cc8f-45ff-99c3-660ea6179b22 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.815861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9201d-b5f6-4cfc-bc75-0be5069d8e1b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:26.840631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.841692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.842229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.842713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.843826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=cedef275f3404a3c8e618cb48f2afc16) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:26.844377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.846086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.851985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:26.852800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:26.853072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:26.853339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:26.855882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 341/684] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/role_assignments?user.id=cedef275f3404a3c8e618cb48f2afc16&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:26.859874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:26.872978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:26.878372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:26.904532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:26.905516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:26.906585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 344/685] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:26.916659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.026696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb9da4-71bd-4bd0-8c8b-32ef488470f4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.063043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.063772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.064093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.064369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.065222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:27.065526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.067115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.085162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 345/686] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:27.091552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.105360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adb0d2-4ed6-4ac5-a197-52db671bc190 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.150470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.151305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.151588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.151911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.170215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:27.178514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:27.179463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:27.180363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 342/687] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:27.185819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.211909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe036c-f48f-4ad5-9647-7fba4a7149c1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.249282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.249951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.250336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.250607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.288154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276b6a8-1745-4d35-96ae-8e75790d5eae None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.323036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.323742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.324025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.324301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.325054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:27.325352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.326787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.327719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.329513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.336532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 343/688] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:27.342151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.442673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d27a-4294-416a-b905-7ef8ed51b080 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.479437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.480326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.480605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.480884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.486211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 346/689] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:27.487215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.508686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.510158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:27.539892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:27.540886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:27.541797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:27.541797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:27.541797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:27.541797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:27.549927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 344/690] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:27.555534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.649803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2a97c-2629-42c9-b95f-c9e32e5931ef None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.681571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767837-3740-44e6-ae03-b374068fdff9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.714919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.715513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.715814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.716086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.716809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:27.717108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.718890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.731527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 345/691] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:27.737142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.740395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.741288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.741568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.741842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.765651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.767513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:27.812424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:27.813471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:27.814380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:27.814380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:27.814380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:27.814380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:27.814380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 347/692] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:27.822719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:27.843178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d2691-33a7-4e2b-9f42-e7076cd29c25 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:27.879296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:27.880193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:27.880471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:27.880740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:27.888153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:27.889605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:27.904170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:27.905122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:27.906093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 346/693] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:27.911196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.011165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28382b5-9816-467e-93bd-c208cefa09ca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.047714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.047714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.047714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.047714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.050186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:28.050186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.050186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.054408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c858dd0-d071-4a4a-805c-8f58fe5ef4e2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.071712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 347/694] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:28.072194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.129300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.130342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.130887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.131362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.132317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:28.132870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.143178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.159500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 348/695] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:28.173675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.174098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a94d8-7ef1-4511-9bab-fdd56be7d6c6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.207336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.208157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.208443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.208715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.281195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.283037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.371741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922c04a-b588-4f47-8965-13eee01e6542 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.417747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 348/696] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:24:28.428726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.432566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.433613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.434036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.434447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.448580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.452977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:28.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:28.478738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:28.479967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:28.493986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 349/697] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:28.499818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.572793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9453-cad4-4397-a853-cbc0c21d7c6e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.609778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.610888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.612632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.613099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.630428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.633098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:28.664355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:28.665518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:28.666544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:28.666544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:28.666544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:28.666544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:28.669724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 349/698] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:28.670992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.691907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2200bd-2ae7-480b-b62d-6144f5eb8e42 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.736330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.737333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.737771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.738184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.739125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:28.739586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.743196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.777256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 350/699] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:28.780950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:28.896204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dfcde-ce1a-49c3-bcc5-2414852c8353 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.910639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe76f61-917c-4a4c-8b17-37cc7a274ccc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:28.930552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.931550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.932936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.934204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.935409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=8771b05277f14efa9650690aae4587f6) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:28.937170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.942488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.953004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 351/700] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/role_assignments?user.id=8771b05277f14efa9650690aae4587f6&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:28.976031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:28.977221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:28.977727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:28.978252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:28.979274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:28.979838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:28.981509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e23fcb-d326-45ba-b282-d03378079d1c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:28.999294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 350/701] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:29.006057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.104563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa82d1-a26b-4dd9-a4a1-d3a25d8e31b8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.105463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa82d1-a26b-4dd9-a4a1-d3a25d8e31b8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.105939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa82d1-a26b-4dd9-a4a1-d3a25d8e31b8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.108745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 351/702] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:29.116302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.116623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.116868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.147356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498121-49ad-4464-9f95-7fd1b9f18305 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.160670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:29.161899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:29.204648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.205543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.205805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.206105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.216077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.217876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7184b1aa-5ce8-47cc-9928-491ffa0b0188 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:29.234174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:29.235216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:29.236176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 352/703] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:29.237087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ebefa-418d-4333-ac30-ef9a218480f0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.237371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ebefa-418d-4333-ac30-ef9a218480f0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.237645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ebefa-418d-4333-ac30-ef9a218480f0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.238877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 353/704] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:29.244901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.245040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.245286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.252001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 352/705] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:29.253473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.267175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:29.268436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:29.346468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 354/706] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:24:29.347935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.377562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd19529-ebda-40eb-8d33-02214fbedd29 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.425498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.426184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.426461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.426734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.427542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:29.427944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.429523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.443320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 353/707] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:29.445134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.475904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90354a-3f29-4810-8998-7de16fc7e9c4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.510667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.511895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.512371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.512835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.524352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.526126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:29.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:29.545463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:29.546361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:29.546361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:29.546361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:29.546361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:29.549421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 355/708] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:29.549545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a97cb-567b-4999-96c3-dfcc15c94636 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.550565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.585791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.587301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.587301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.587301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.587835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.589223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:29.605534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:29.606615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:29.607474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:29.611961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 354/709] 10.222.0.79 () {56 vars in 1129 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:29.613685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.661075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a2d33-e8f6-4789-8fdf-1e0ae248a897 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.708095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.709182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.709666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.710130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.711159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:29.711666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.713815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.721958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 356/710] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:29.723038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.758927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57f7-8853-42da-a65b-426fc1bf74ea None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.804716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.806050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.806543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.807017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.807994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:29.808528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.810826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.839584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 355/711] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:29.840979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:29.927464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2271-c5e7-4521-9fcf-da4add27a0e4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:29.968358 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:29.969174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.970100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.970378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.971116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:29.971425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:29.972859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5d40e-308e-4ca7-b39f-a1c0ac0e6f46 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:29.982820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 357/712] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:29.984538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa283-9664-4edb-a48e-23a4036668b1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.985102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa283-9664-4edb-a48e-23a4036668b1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.985841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa283-9664-4edb-a48e-23a4036668b1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.987841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 358/713] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:29.988755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfa283-9664-4edb-a48e-23a4036668b1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:30.087493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d48c03-c2d6-4654-b531-7b161054615a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:30.099193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfa283-9664-4edb-a48e-23a4036668b1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:30.121883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:30.123370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.124137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.124612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.125722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:30.127940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:30.133627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:30.134359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.134643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.134971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.135784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:30.136096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:30.137513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d01c-d70b-455a-b7a3-e4cecec8c5c3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:30.144362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 359/714] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:30.153121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.153507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.153673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.154852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 356/715] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:24:29 2022] POST /identity/v3/users => generated 254 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:30.173809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:30.175547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:30.255134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 360/716] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:30.288839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:30.411586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b40781-baf4-4fe0-a664-814395f9b01d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:30.452202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:30.453096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.453483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.454426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] PATH_INFO: `/v3/services/network` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.455105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:30.456539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:30.468698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:30.469898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:30.470764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:30.471544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 357/717] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:30 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:30.477061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:30.585166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6509d-5d01-4e9d-b972-7b2aa934a99c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:30.620820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:30.621883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.622364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.622857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.623818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] RBAC: Adding query filter params (name=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:30.624326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:30.626100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c610ac-5a18-42dc-8079-16d6f3718cbe None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:30.631511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 361/718] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:30.636615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:30.745382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd9c0-405e-4536-8867-087a77a8d755 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:30.782699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:30.783850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:30.784350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:30.784856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:30.785792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] RBAC: Adding query filter params (type=network) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:30.786294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:30.787908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3844-7170-4f35-8900-92f4abbe8a34 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:30.795678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 358/719] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:31.546226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce0b0-aad3-4bc9-8532-668d41cd4e85 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:31.546824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce0b0-aad3-4bc9-8532-668d41cd4e85 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:31.546824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce0b0-aad3-4bc9-8532-668d41cd4e85 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:31.549042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 362/720] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:31.554467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:31.554929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:31.555012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:31.572020 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:31.573346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:31.655120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 359/721] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:31.701394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce0b0-aad3-4bc9-8532-668d41cd4e85 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:31.822594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce0b0-aad3-4bc9-8532-668d41cd4e85 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:31.868445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:31.869264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:31.869689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:31.869794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:31.888591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:31.896526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:31.897514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:31.898982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 363/722] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:31.905607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.051960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f792652-b4a5-405e-a5e8-dab94a4f9f5e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.105720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.106802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.107310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.107812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.108763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:32.109267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:32.111523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242586-2ba6-4fd2-9afb-47b25b45471b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:32.123408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 360/723] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:32.129036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.283587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca93fb-2771-4604-85d9-b0c35bd186a0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.300950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c2b-07e9-4222-abf6-2ae2550238bd None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.301604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c2b-07e9-4222-abf6-2ae2550238bd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.302117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c2b-07e9-4222-abf6-2ae2550238bd None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.304091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 361/724] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:32.326614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.327233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.327733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.337323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.338518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.339000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.344970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.357455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:32.362188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:32.365470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:32.367182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:32.397184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:32.398172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:32.399073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:32.399073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:32.399073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:32.399073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:32.409480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 364/725] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:32.414926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.501233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 362/726] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:32.537933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.552911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51ab68-a521-46da-b16c-ebf4da4dac56 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.591597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.592317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.592581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.592854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.593590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:32.593918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:32.595292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:32.617007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 365/727] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:32.622228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.754929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516cfa-cae0-4973-bfa3-2b3fb299097e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.766962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf704-e689-4d5b-944a-016a70bfd763 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.799866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.799866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.799866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.799866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.805803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:32.807298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:32.824115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:32.825151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:32.828390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 366/728] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:32.835721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.856163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.856993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.857271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.857564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.880804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:32.888388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:32.889336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:32.890171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 363/729] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:32.900723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.967164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e5dc-2455-4fbe-a600-77a63e74f34a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.006493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.007183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.007462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.007777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.008627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:33.008935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.010379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1d4c-778d-45e1-bfab-f037609391b9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.027448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 367/730] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:33.029043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c3709-0653-4f3b-ba93-048c4f045d70 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.029532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c3709-0653-4f3b-ba93-048c4f045d70 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.030001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c3709-0653-4f3b-ba93-048c4f045d70 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.035426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 368/731] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:33.035426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4141-6a22-40c8-a3c1-3a56c862b004 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.035426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4141-6a22-40c8-a3c1-3a56c862b004 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.035426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4141-6a22-40c8-a3c1-3a56c862b004 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.036265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 369/732] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:33.036960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba4141-6a22-40c8-a3c1-3a56c862b004 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.061134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf112c0-bc11-4db0-aec6-949c3ec56b44 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.095760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.096440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.096732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.097052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.097790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:33.098090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.099457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511355b5-a288-4d8e-8315-2ed0232aaaa0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.107328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 364/733] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:33.108555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3630-167c-47af-bb4f-6dfa1de255c1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.108838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3630-167c-47af-bb4f-6dfa1de255c1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.109111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3630-167c-47af-bb4f-6dfa1de255c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.126338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2bac3630-167c-47af-bb4f-6dfa1de255c1 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:33.127514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2bac3630-167c-47af-bb4f-6dfa1de255c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:33.141419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba4141-6a22-40c8-a3c1-3a56c862b004 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.176399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.177061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.177339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.177649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.194060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 365/734] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:33.195582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.195898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.196172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.219033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:33.220217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:33.256681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.258150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.288036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 366/735] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:33.289153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.370125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 370/736] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:24:33.370125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.392719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c9c0a-129b-4f4e-bf2e-f3716d579abc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.426472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.427285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.427560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.427860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.437738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.439256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:33.457320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:33.458473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:33.459619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:33.459619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:33.459619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:33.459619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:33.460021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509077a-1f00-48a2-ba90-89bf530ee3f1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.465968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 367/737] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:33.465968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.498230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.498905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.499186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.499458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.500319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.501687 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.517474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 371/738] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:24:33 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:33.520682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.573468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0d85-bc3e-4fc0-ab62-168368d5d14f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.618060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.619316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.619841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.620372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.632776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:33.639269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350156f-5e54-4841-a109-1af093990d0b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:33.642385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:33.643374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:33.644250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:33.647128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 368/739] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:33.648331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.684364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.685206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.685474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.685744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.697595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.699301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:33.718618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:33.719776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:33.720683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:33.720683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:33.720683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:33.720683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:33.720683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 372/740] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:33.721400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.762781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d9b2-b8ed-45db-90d0-1913b7bb2083 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.802345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.803950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.804446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.804912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.805835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:33.806334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.807958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.822393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 369/741] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:33.826970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.851818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d2dd-e7cf-46bf-a6d3-7a1d13d181fb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.896108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.896715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.896992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.897262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.898012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:33.898314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.899718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.913521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 373/742] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:33.914454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.954036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69552b-7f89-4359-96d5-8e1e3fd1e2b5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.988911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.989766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.990143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.990504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.991326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:33.991735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.993234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.009679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 370/743] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:34.009679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.022239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe1125-c5e4-4618-802a-bf376f7afe9a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.055414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.056271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.056534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.056806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.107895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f31c-c7be-4bda-a603-6d7a9e217c7d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.146381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.147277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.147651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.148062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.160472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.162141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9108465a-170f-42c0-9eff-bfbee77d7439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:34.181544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:34.182703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:34.183840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:34.183840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:34.183840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:34.183840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 371/744] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0dc5-7881-4fd8-8ab6-1b08aa228108 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0dc5-7881-4fd8-8ab6-1b08aa228108 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0dc5-7881-4fd8-8ab6-1b08aa228108 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 372/745] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:34.191875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0dc5-7881-4fd8-8ab6-1b08aa228108 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.192405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.193057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a9e6f683-4799-4681-951a-ea49a7813dbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:34.208332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:34.209333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 374/746] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.215394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.216296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.231033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:34.232239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:34.296632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0dc5-7881-4fd8-8ab6-1b08aa228108 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.307376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 375/747] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:24:34.310273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.341226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.341937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.342213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.342482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.349435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.350895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:34.364877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:34.365795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:34.366677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 373/748] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:34.367616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.412134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae15614-c6cc-4044-a260-0b3b0b54315f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.446120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.446877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.447228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.447494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.448313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:34.448614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.449976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.461222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 376/749] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:34.462022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.471943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dc88-4dbe-4a1b-a17e-f252ccea24e3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.505234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.506022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.506302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.506574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.507404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:34.507728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.509157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.528333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 374/750] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:34.529226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.563656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e553-a18e-4748-9805-538da2f77f8d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.596822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.597503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.597785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.598063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.598814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.600220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.623729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 377/751] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:24:34 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:34.623729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.646027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b312-d087-4951-83c7-c6366c8ee46b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.698029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.698699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.699036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.701556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.701556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:34.701556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.701993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.720613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 375/752] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:34.721629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.727204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b222-0e10-4a4f-a840-b40480a11a3e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.764004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.764855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.765137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.765411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.774736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.776377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:34.793023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:34.794086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 378/753] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:34.796131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.842459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8b32-2e4a-43c6-9b24-dcf09e9656bf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.895492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.897039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.897039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.897039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.911581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.913105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a26aa-502f-4255-9772-02aa6ce46bb2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:34.913238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:34.945387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:34.946581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:34.947991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:34.947991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:34.947991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:34.947991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:34.949314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:34.950086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.950242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 376/754] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:34.950462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.950824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.951477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:34.951997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=8771b05277f14efa9650690aae4587f6) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:34.956561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:34.956561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:34.961790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 379/755] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/role_assignments?user.id=8771b05277f14efa9650690aae4587f6&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:34.968445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.076053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af380-9096-4cb1-bcf2-3f2508e63f32 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.126322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.127300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.127754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.128178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.129241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:35.129710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.131356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.171332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182d7c-03dd-43bd-ae98-2cb7e31550f9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.176485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 377/756] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:35.182262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.268541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.269524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.269949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.270368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.271275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:35.271746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.273272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.293231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 380/757] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:35.301928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.358805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69e6f0-b4d8-4500-9c68-6873650f3383 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.432348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.433297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.433729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.434145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.462355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03670dbe-b1c1-4ae8-9482-58c01ff028fb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.533854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.534924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.535352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.535829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.549779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.552858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.566267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.568016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:35.577478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:35.578639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:35.579743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:35.589323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 381/758] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:35.596312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.713013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2159c4-5fb4-4b4d-a418-c4061ec92f0e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.747713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.747713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.747713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.747713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.748634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:35.748902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.755710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.765809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 382/759] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:35.773580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.787372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 378/760] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:24:35.792565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.913109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def034fd-fc32-4777-b3a6-0be15c771083 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.921391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfacf60-fc7e-4921-9846-7e82596b0360 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.957111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.958038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.958315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.958590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.958713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.959474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.959800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.960077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.960778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=e2801984340040c499b17ef6e0324033, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.962615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bf80b-6e0b-45f0-b413-5d4905fd258f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.971182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.972790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.979759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 383/761] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:35 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:35.982176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427edf-7ddc-4739-ae54-a6c8f1ff7faf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.982734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427edf-7ddc-4739-ae54-a6c8f1ff7faf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.983484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427edf-7ddc-4739-ae54-a6c8f1ff7faf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.985625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 384/762] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:35.996277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:35.997257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:35.998140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:35.998140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:35.998140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:35.998140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:35.998140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 379/763] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:35.999665 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.000205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.000484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.004400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.039744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:36.042142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:36.185209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 385/764] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:36.214640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acee317-0139-47d7-bc30-93938d3512c0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.226876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.252217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.253247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.253724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.254240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.255159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:36.255665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.257266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.273468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 380/765] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:36.274991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.333169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5000-97f8-4c18-9403-a32256b35d1b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.368566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.369451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.369667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.369937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.370600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.372008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.385326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd542d-3da5-4acd-9f0c-942c399f5d32 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:36.386657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:36.387557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:36.392671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 386/766] 10.222.0.79 () {56 vars in 1129 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:36.397429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.441373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.442619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.443090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.443553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.461001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.462795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:36.486150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:36.487114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:36.488042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:36.490619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 381/767] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:36.496482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.507755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae229-505e-49d7-bfe6-045790baf7fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.544786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.545471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.545750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.546020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.546860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:36.547309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.551930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.561267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 387/768] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:36.567726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.643558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b45ce-2066-4796-aba7-e57fcb85c45b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.705351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.706040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.706320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.706597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.707396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:36.707712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.709178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.736871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 382/769] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:36.743017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.770811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c9cc-263c-4f93-b685-cc7bbe9b0f9b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.811839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.812778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.813065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.813336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.814077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:36.814390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.815810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.822052 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 388/770] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:36.827815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.909089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64f04d-037a-4826-87e5-7ed53bf5e1b5 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.954908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.956393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.956690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.956971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.957822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e1b7478c84744e0e80ebda09dca94998) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:36.958135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.962595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.981170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 383/771] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/role_assignments?user.id=e1b7478c84744e0e80ebda09dca94998&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:37.007472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3ea3-25cf-47e4-a081-76dcf5a9208f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.050031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.050785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.051070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.051347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.052185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] RBAC: Adding query filter params (interface=public, service_id=447ceed6ff9c4beb9ce2ec0ea5eb767a, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:37.052500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.053886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1a07-eca3-4753-a094-c9f5220c6c83 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.067926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 389/772] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/endpoints?service_id=447ceed6ff9c4beb9ce2ec0ea5eb767a&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:37.073668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:37.112008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e01-ddb3-4def-b770-98128c18641c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.112355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e01-ddb3-4def-b770-98128c18641c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.112579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e01-ddb3-4def-b770-98128c18641c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.114457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 390/773] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:37.120363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.120684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.120970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.138249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:37.139481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:37.241038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf41b8e-b8af-4712-b4ac-9cc8628da1dc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.268415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 391/774] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:37.281082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.281892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.282167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.282447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.283146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.284557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.290265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 384/775] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:37.304286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:37.444496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98e05b-f054-47fd-9065-85682723c366 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.487018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.488048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.488326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.488593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.489274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.490670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:37.512939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:37.515399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:37.517615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 392/776] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:37.528889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:37.664733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f91580-5fc5-47e5-b3b5-a42f74acb641 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.707976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.708725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.709045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.709280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.710035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] RBAC: Adding query filter params (name=network) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:37.710344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.711752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.717045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 385/777] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:37.723333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:37.886256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de32b-7e16-4ba2-ace8-2a3ba3fb71d8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.933087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.934148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.934603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.935067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.935820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:37.936127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.937623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4bd8f-8f6d-4657-b750-f3e4cc2e2c88 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.945632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 393/778] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:37.956839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.076952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da63f-c555-4e02-8ab7-11cd4cbeedda None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.077138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da63f-c555-4e02-8ab7-11cd4cbeedda None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.077542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da63f-c555-4e02-8ab7-11cd4cbeedda None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.079261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 394/779] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:38.084878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.085176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.085436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.103498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:38.104750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:38.115312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633a88-7b95-4bba-800f-915f051c7516 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.183769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 395/780] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:38.190255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.191234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.191745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.192343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.193378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] RBAC: Adding query filter params (interface=public, service_id=6f3dd02dc7f6453d9457cf8965c65992, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:38.193904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:38.195488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:38.209770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 386/781] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/endpoints?service_id=6f3dd02dc7f6453d9457cf8965c65992&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:38.215315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.229778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.403129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0bdde-6240-47f1-b3fc-16e3dae56d82 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.423944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad21d-dc35-4427-83f4-d85e8b00c5e1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.452525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.453570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.454040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.454329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.465721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:38.478957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:38.479968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:38.480792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 387/782] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:38.486844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.505210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.505912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.506194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.506471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.507186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:38.508633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1fd27-73eb-4cf0-ab2b-9e0ff811ebb0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:38.519306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 396/783] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/services => generated 772 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:38.674908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01097df-1ae4-482d-97f1-10ff91b31739 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.694408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900546-20c5-40bb-906a-f9def9f6fe31 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.694909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900546-20c5-40bb-906a-f9def9f6fe31 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.695400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900546-20c5-40bb-906a-f9def9f6fe31 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.698341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 397/784] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:38.703828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.704156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.704392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.742124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.742813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.743095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.743463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.744237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:38.744542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:38.745918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:38.747656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:38.748930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:38.759572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 388/785] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:38.768157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.827454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 398/786] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:38.854849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.897849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631bc1-1f60-4f93-9f6c-8f59c56b6f41 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.947610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.948840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.951919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.952438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.973722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:38.975976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:38.979711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6bdc-3fdd-446e-9f79-3f07205a7c0f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:39.015714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:39.016679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:39.017562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:39.017562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:39.017562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:39.017562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:39.017562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 389/787] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:39.021064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.024258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.025125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.027409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.027715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.048415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:39.063735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:39.064730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:39.065647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:39.069476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 399/788] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:39.077465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.191713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf41b2-48e2-4015-989c-ba45a85f8c8f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.231326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.232408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.234379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.234861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.235873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:39.237295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.239528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.244908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dad67-d460-4503-bbd4-dc21cf76bd7e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.261412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 400/789] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:39.267746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.313231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.314849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.315474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.316805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.318911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:39.319425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.321046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.345011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 390/790] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:39.352004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.436723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3074bd-22df-4f0c-9be0-458f32ff19c4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.500761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.501671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.501949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.502216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.518327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.519812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.534231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b3d7-4102-4abf-a1df-0aec8a772d6e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:39.553772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:39.555036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:39.555971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:39.555971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:39.555971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:39.555971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:39.556675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 401/791] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:39.560557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.608448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.609346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.609627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.609904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.620527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.622021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:39.651032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:39.652136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:39.653119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:39.655228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 391/792] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:39.660728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.753011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499edb7-b713-475e-80f3-00a44c487833 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.824454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.825887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.826494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.826968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.827989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:39.828688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.830305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.851672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 402/793] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:39.857939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.870323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4596e-cb26-4a65-a060-396ae84c12ce None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.913192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.914332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.915136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.915568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.916847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:39.917460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.919371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864d37-ba6c-45c7-af76-a31c2c9f22d4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.942831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 392/794] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:39.949271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eed33-67e8-4ff2-819b-03f04fd9df6f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.949737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eed33-67e8-4ff2-819b-03f04fd9df6f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.950166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eed33-67e8-4ff2-819b-03f04fd9df6f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.951763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 393/795] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:39.953080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eed33-67e8-4ff2-819b-03f04fd9df6f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.978348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493164a-1594-4d28-857b-deef63c8602a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.028669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.030703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.031315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.031877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.041438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.043705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c7fa3dbd-751f-4170-8d2a-09d3e26f633f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:40.063217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:40.064507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:24:40.065733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:40.067364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eed33-67e8-4ff2-819b-03f04fd9df6f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.073871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 403/796] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:40.073871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.073871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.073871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.091079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:40.092320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:40.113758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.114579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.114858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.115132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.125594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.127303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:40.150038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:40.151072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:40.151993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:40.151993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:40.151993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:40.151993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:40.156478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 394/797] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:40.157437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.170315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 404/798] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:40.171422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.262261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4a9e-7a1a-4e87-a8fb-5fcd94e4dec7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.272502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733749c-9bc2-4eda-b5b1-aee593900124 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.296901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.297628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.298203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.298510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.299355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:40.299635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.301159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.308413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.309079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.309356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.309602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.310324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:40.310631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.312010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871c17-557e-4325-9edd-32b42486a2cf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.323403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 405/799] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:40.324006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 395/800] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:40.324181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c532d-f391-41e2-890d-267cba57aa23 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.324463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c532d-f391-41e2-890d-267cba57aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.324731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c532d-f391-41e2-890d-267cba57aa23 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.325560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.326195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 406/801] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:40.326881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c532d-f391-41e2-890d-267cba57aa23 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.429088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c532d-f391-41e2-890d-267cba57aa23 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.438240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46fe6-a318-4d5a-9bf5-93c5fc774a88 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.463818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.464483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.464759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.465019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.472758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.473622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.473921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.474252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.484319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:40.492010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:40.493147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:40.494196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:40.498079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 396/802] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:40.498786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.536473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.538332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9160aa-1d8a-4efa-bdbe-6420806db09d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.596052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decda788-0d5a-4388-8973-62520f9e3903 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.628712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.629522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.629804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.630078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.641370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 407/803] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:24:40.641370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.641370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.641859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.641989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.642068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:40.654294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:40.655210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:40.656183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 397/804] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:40.656697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.660767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:40.661972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:40.735712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 408/805] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:40.735712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.754480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e230f5-9875-403d-9245-e3e8bc02911b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.788352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.789039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.789319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.789593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.790340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:40.790643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.792043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.805657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 398/806] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:40.805657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.837684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d59a9b-3bae-4d72-9bcd-0af3811822cc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.875227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.876131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.876418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.876688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.887107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.888602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:40.906820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:40.907742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:40.908732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:40.908732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:40.908732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:40.908732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:40.908959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649639ae-c423-41b7-b45e-b4ddc44ed47f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.910230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 409/807] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:40.910773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.941025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.941703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.941992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.942266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.943054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:40.943448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.945203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.963291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 399/808] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:40.963291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.019723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183acfc-2b14-46e5-b355-8b4787b458c2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.051860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.052690 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.052973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.053240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.053903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.055275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.063523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc183-ce1a-42b6-a98a-9b94f8361160 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:41.067260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:41.068355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:24:41.069193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:41.072008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 410/809] 10.222.0.79 () {56 vars in 1129 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:41.073048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.097155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.097940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.098217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.098486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.109194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.110663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:41.127863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:41.128768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:41.129659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:41.129659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:41.129659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:41.129659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:41.129659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 400/810] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:41.129943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.175063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96c135-d197-4b0c-ac36-b4790776c89b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.206784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.207472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.207733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.208005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.208720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:41.209020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.210381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.221782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 411/811] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:41.222458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.224011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a129-986b-4e8e-9905-0ad86786fa9f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.256961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.257859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.258136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.258402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/8771b05277f14efa9650690aae4587f6/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.260372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=8771b05277f14efa9650690aae4587f6, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.261816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.276604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 401/812] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:41 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/8771b05277f14efa9650690aae4587f6/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:41.277229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.349019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277f9b-4f5a-4310-8071-77d6bea2d009 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.382120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6fd7-04ac-472a-b19b-68fb5cef1fc2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.385890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.386579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.386858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.387128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.387877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:41.388185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.389570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3657a-9fe8-4d4f-8031-c92a9a5907b6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 412/813] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafabb-59a5-422b-8206-487e1609554a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafabb-59a5-422b-8206-487e1609554a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafabb-59a5-422b-8206-487e1609554a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 413/814] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:41.402100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeafabb-59a5-422b-8206-487e1609554a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.420302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.421025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.421305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.421559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.422360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:41.423200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.424699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fa3cb-b448-49ed-9892-85bd576fa072 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.436879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 402/815] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:41.438662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.438950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.439225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.456283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:41.457504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:41.513672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeafabb-59a5-422b-8206-487e1609554a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.524910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 403/816] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:41.531707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.548594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.549495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.549878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.550244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.557352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.558852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:41.573205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:41.574157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:41.575067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:41.578975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 414/817] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:41.579966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.630390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395406-3945-4659-aaec-94d1a2c5ef88 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.665060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.666124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.666632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.667155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.668500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:41.669028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.671681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.680805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 404/818] 10.222.0.79 () {56 vars in 1124 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:41.682011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.698088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be359f-da11-4682-9501-f6cff8978b05 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.732511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.733338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.733621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.733897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.741778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.743307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:41.758101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:41.759078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:41.760035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:41.764043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 415/819] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:41.764672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.785756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24878cc-e872-49de-9d87-b81d5770b347 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.822433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.823259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.823541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.823854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] PATH_INFO: `/v3/services/network` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.824520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.825945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:41.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:41.838555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:24:41.839395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:41.843817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 405/820] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:41.844865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.868545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91fbf3-2065-40d7-8ee2-1f4f0b1d30e5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.900669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.901340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.901614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.901883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.902666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:41.902968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.904458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.920987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 416/821] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:41.920987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.942515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee353-14d4-49d2-bf71-e12f11fd57fa None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.979189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.979903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.980198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.980472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.981219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.982614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.010731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 406/822] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:24:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:42.020822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.034818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11879-7752-4e72-919e-c3fa17fc1346 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.086107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.086954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.087133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.087412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.088425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:42.088622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.090095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.111869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 417/823] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:42.113073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.145480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dee859-58c4-4390-8597-aca92f8be8ec None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.184037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.185083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.185561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.186026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.187007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] RBAC: Adding query filter params (name=network) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:42.188065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.189701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.195377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 407/824] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:42.196551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.225101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83272c-ce62-4fe1-ac0a-bfcc90e65715 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.266588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.267264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.267546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.267854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.269005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:42.269112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.270520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.278748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 418/825] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:42.279510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.319786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633b51-b8ce-4e48-b105-29abb1723107 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.366164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.368057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.368540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.369032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.389815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9a6a-a33b-4e3a-8453-2f8073164e45 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.394068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.395818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:42.417878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:42.418868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:42.420345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:42.420345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:42.420345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:42.420345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:42.420345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 408/826] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:42.426003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.431908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.432843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.433314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.433789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.434740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] RBAC: Adding query filter params (type=network) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:42.435643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.437697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.445151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 419/827] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:42.452182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.585462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3057-5ef9-497e-a8f5-f840b7138795 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.610145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282949d-746a-4fbe-9084-73354bcaa511 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.624998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.625951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.626235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.626513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.627249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:42.627561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.629458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.649492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 409/828] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:42.650645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:42.653488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.653488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.653488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.653488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.653883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.655085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.691233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 420/829] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:24:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:24:42.776588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084799a-ff69-43e9-8c5d-0a6282cb2a3a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:42.829998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:42.831149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:42.831653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:42.832143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:42.846223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:42.848056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:42.862909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:42.863945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:42.864825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:42.867447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 410/830] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:42.873149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:43.013963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948106d-35d8-4446-91f0-b15dd17ed498 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:43.060685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:43.061373 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:43.061650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:43.061920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:43.062838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:43.063143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:43.064621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1e3c-cef5-49e4-8cad-65fc2608f148 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:43.081793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 421/831] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:43.087949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:43.200341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048812bd-9aae-4a1d-bb1a-e6188e1c5d57 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:43.241042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:43.241957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:43.242234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:43.242504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e1b7478c84744e0e80ebda09dca94998/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:43.262945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=e1b7478c84744e0e80ebda09dca94998, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:43.264654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce7480-ba29-422d-a573-ca073ddc2201 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:43.279974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 411/832] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:43 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e1b7478c84744e0e80ebda09dca94998/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:43.569796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3ee8-14f6-4830-a2a8-4ad36cb1dab0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:43.570301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3ee8-14f6-4830-a2a8-4ad36cb1dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:43.570301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3ee8-14f6-4830-a2a8-4ad36cb1dab0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:43.571889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 422/833] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:43.577401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:43.577691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:43.578008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:43.594983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:43.596196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:43.663262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 412/834] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:43.687036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3ee8-14f6-4830-a2a8-4ad36cb1dab0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:43.789095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3ee8-14f6-4830-a2a8-4ad36cb1dab0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:43.829680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:43.830566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:43.830849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:43.831125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:43.850792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:43.858419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:43.859586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:43.860469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 423/835] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:43.865839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:43.971216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6836bb9-835e-4549-81e3-29416265e85d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.005986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.007088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.007567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.008108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.009054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:44.009553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.011715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.021155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 413/836] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:44.028724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.130419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a124dda-aa70-41f0-b079-9b43e9a3e1c1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.163697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.164506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.164780 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.165047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.176588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.178224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:44.195830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:44.196797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:44.197685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:44.197685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:44.197685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:44.197685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:44.197685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 424/837] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:44.204251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.304251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01915-8d40-4e1b-9cc6-ab539c7bdfe4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.337778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.338896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.339400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.339927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.340855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:44.341379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.342966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.355765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 414/838] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:44.361605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.472497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84c00-02ea-4e06-9873-a4ad880c2a41 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.508073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.508953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.509230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.509501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.517301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.518752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d3945779-d768-446d-8a4f-4cd74936d8d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:44.533196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:44.534204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:44.535256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 425/839] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:44.542340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.626156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55629b4-6189-402a-8634-83e7bf7317cc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.626723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55629b4-6189-402a-8634-83e7bf7317cc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.626723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55629b4-6189-402a-8634-83e7bf7317cc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.631717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 426/840] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:44.635708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.635708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.635708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.645907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e7cb-33a7-48aa-8cf8-b63ea2d4cc93 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.650583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:44.651797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:44.681315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.682379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.682634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.682991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.683976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:44.684263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.685878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.708524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 415/841] 10.222.0.79 () {56 vars in 1135 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:44.714278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.728104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 427/842] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:44.745928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.833755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6f0d-b4c7-46fe-931c-f50ef9f83307 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.862282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0b3e-ce09-497d-8191-2d9ab3cd65d1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.895710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.895710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.895710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.895710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.935717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.935717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.935717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.935717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.936136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.939708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-6d8fc0d4-e72b-41e7-948b-e3e28de590f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:44.955714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:44.956982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:44.958120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 428/843] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:44.959114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3fdb-ce70-496c-8b2b-469e8735e441 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.959114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3fdb-ce70-496c-8b2b-469e8735e441 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.959114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3fdb-ce70-496c-8b2b-469e8735e441 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.959114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 429/844] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:44.959415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3fdb-ce70-496c-8b2b-469e8735e441 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.979838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.979838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302367b-089d-4cbc-a354-e1f379feb4f4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.091298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3fdb-ce70-496c-8b2b-469e8735e441 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.116344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 416/845] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:24:45.117847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.118191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.118524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.139863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:45.141187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:45.148161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.149145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.150013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.150505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.151851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:45.152346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.154658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.161592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 430/846] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:45.162734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.216880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 417/847] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:45.217743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.316154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954ad1-db37-46fb-b513-9df2b72ff84f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.327889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6e1db-f5d4-45d8-b675-9dd9d535867d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.349246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.350225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.350825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.351105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.360495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.361169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.361445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.361717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.362426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:45.362726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.364123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.365401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.367641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.368572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 418/848] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:45.369348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:45.389337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:45.390730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:45.392379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:45.392379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:45.392379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:45.392379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:45.394523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 431/849] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:45.399153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.505568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449af-5da5-4c2b-b5cd-d4f28d85f5a6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.536229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ef76-cdf3-47a8-a17d-92a33919a851 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.541713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.542574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.542850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.543183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.543960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.545354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:45.559252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:45.560318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:45.561140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:45.565924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 419/850] 10.222.0.79 () {56 vars in 1132 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:45.567474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.584504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.585605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.586077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.586539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.587712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:45.587712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.589475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.603380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 432/851] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:45.609454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.691572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80720-f8f6-4256-acb7-d8f3ad85bdf3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.708247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba2a0-5ed8-4d94-8b89-7ac854c6a331 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.727299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.728012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.728296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.728682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.729402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:45.729707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.731092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7d916-dd98-4721-bb8c-defd0d148a63 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.740778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 420/852] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:45.740778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5aa8e-b262-4c76-b274-0ae183de3d58 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.740778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5aa8e-b262-4c76-b274-0ae183de3d58 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.740778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5aa8e-b262-4c76-b274-0ae183de3d58 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.740778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 421/853] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:45.744581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5aa8e-b262-4c76-b274-0ae183de3d58 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.749949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.750770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.751060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.751327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.758777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.760269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a0955f31-18f4-4232-bab5-73c3c5af4436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:45.774091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:45.775172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:45.776281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:45.780004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 433/854] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:45.781478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.781921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.782209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.800196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:45.801357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:45.856569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5aa8e-b262-4c76-b274-0ae183de3d58 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:45.876135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 434/855] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:45.876135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:45.898032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:45.898724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:45.899003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:45.899275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:45.900033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:45.900334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:45.901747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:45.906354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 422/856] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:45.907205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.011890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffcf58-57c5-46d9-90bd-422bf4cc6023 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.035847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148b05-7549-4624-b85e-df68047daeeb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.057164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.058408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.058697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.058971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.060106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:46.060418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.062762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.072690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.073427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.073703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.073972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.078444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 435/857] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:46.084359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.088592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:46.097970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:46.098969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:24:46.099854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:46.102632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 423/858] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:46.110099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.200573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ce18-d5a8-4bad-ad81-60e8cddf249e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.233837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a0d5-b677-476c-96bd-763791cf2b34 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.234435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.236100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.236100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.236100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.236372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=8771b05277f14efa9650690aae4587f6) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:46.236808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.238308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.251732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 436/859] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/role_assignments?user.id=8771b05277f14efa9650690aae4587f6&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:46.291717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.291717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.291717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.291717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.292363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:46.292612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.294000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.304082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 424/860] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:46.309585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.418689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281565-fd3e-4dcc-8264-2049d3d18e16 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.455714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.455951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.456198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.456351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.467601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.469179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:46.486697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:46.488831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:46.490261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:46.490261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:46.490261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:46.490261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:46.490261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 437/861] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:46.494099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.593806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe93a40-95e6-4eb0-be08-2c06b28e326e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.626827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.627511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.627814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.628084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.628807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:46.629107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.630485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.643707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 425/862] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:46.648848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.749756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c85-3979-45c2-9da3-6fcea593bd2c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.783064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.783923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.784199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.784469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.792393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.793834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:46.809152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:46.810147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:46.811105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 438/863] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:46.816485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.927192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1b5c6-90ca-473d-84b3-ede12b58a122 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.960980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.961672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.961948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.962218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.963058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:46.963360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.964884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.982455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 426/864] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:46.988791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.093789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acdcb4-1e4a-4605-a9b5-594aa0e5dd5f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.127041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.127716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.128007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.128275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.196489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.198019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:47.293892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 439/865] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:24:47.300838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.396607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96421e7-9274-40d5-a17a-3d9ccadf8a4d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.429960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.431157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.431705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.432173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.442416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.444355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:47.463339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:47.464354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:47.465725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:47.465725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:47.465725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:47.465725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:47.465725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 427/866] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:47.472190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.572833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65064e87-2e7b-4f4b-8947-17967475e5e7 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.606493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.607168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.607441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.607728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.608459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:47.608760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.610378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6446d-eb1c-4b7e-992b-67e06dd86d5b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:47.622136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 440/867] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:47.628878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.648823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342438dc-3451-4679-8e98-7302ceb7b590 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.649108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342438dc-3451-4679-8e98-7302ceb7b590 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.649309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342438dc-3451-4679-8e98-7302ceb7b590 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.650962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 441/868] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:47.656165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.656448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.656730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.673591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:47.674765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:47.747641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edea45c-fbbf-43e3-8f3b-35ab151eda37 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.748031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 442/869] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:47.765999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.786705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.787933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.788403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.788680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.798577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.800177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:47.819439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:47.820450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:47.821384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:47.822409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 428/870] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:47.832770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:47.884211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdad89-e0d7-4e99-98c3-3e42593fffe9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.931989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.933159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.933660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.934132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.934238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fad78-4839-4ae9-9a37-a8a9c119cd97 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:47.935161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.938435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:47.957397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 443/871] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:24:47 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:24:47.982941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:47.984974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:47.985546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:47.986151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:47.987242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:47.987805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:47.989719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a721ae-346f-4fbc-9d30-000fa57a1107 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:48.011971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 429/872] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:48.014250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:48.158528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3372e-d37d-46f9-b6d8-fa87bd5b8afb None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:48.195355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:48.196369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.196799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.197244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.198233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e1b7478c84744e0e80ebda09dca94998) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:48.198737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:48.200409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:48.206029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4356b-0012-444e-913d-66437934cda8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.206334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4356b-0012-444e-913d-66437934cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.206601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4356b-0012-444e-913d-66437934cda8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.211137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 430/874] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:48.211275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 444/874] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:48 2022] GET /identity/v3/role_assignments?user.id=e1b7478c84744e0e80ebda09dca94998&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:48.216033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149db2-f2e9-44e2-8063-c372cd149454 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.216348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149db2-f2e9-44e2-8063-c372cd149454 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.216596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149db2-f2e9-44e2-8063-c372cd149454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.234730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-10149db2-f2e9-44e2-8063-c372cd149454 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:48.235992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10149db2-f2e9-44e2-8063-c372cd149454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:48.313072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 431/875] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:48.336963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:48.459294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60f30-6ba0-4b21-9319-0125cdd85b1e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:48.493448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:48.494177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.494471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.494744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.495474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:48.496972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d3643-1b50-4089-aa44-35481d2bde56 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:48.516864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 445/876] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:24:48 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:48.720218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d11a-b7b5-430a-b861-484a17ea322e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.720417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d11a-b7b5-430a-b861-484a17ea322e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.720709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54d11a-b7b5-430a-b861-484a17ea322e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.722305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 432/877] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:48.727750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.728042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.728330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.746380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:48.747562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:48.822197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 446/878] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:48.844232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54d11a-b7b5-430a-b861-484a17ea322e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:48.946394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54d11a-b7b5-430a-b861-484a17ea322e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:48.981201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:48.982414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:48.982895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:48.983390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:48.984354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:48.986160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:48.999000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:49.000670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:49.001534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:49.004357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 433/879] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:49.013015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:49.113487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb9e1-ee78-4630-ab33-656591c1c284 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:49.151752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:49.152939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:49.153438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:49.153937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:49.154803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:49.155113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:49.156614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895c1d-be69-4cb4-b961-e00ed1b7983d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:49.166285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 447/880] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:49.174188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:49.273535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf6131-a528-458a-bd1b-408a25682d3b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:49.307287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:49.308001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:49.308286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:49.308568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:49.309285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:49.309589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:49.310971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d3e71-2d94-4901-af7f-b5bfeafd759c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:49.315976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 434/881] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:50.307017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde842-a16a-4daa-a849-e2c63690fb53 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.307767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde842-a16a-4daa-a849-e2c63690fb53 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.307767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde842-a16a-4daa-a849-e2c63690fb53 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.309237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 448/882] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:50.315243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.315534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.315856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.333460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:50.334653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:50.403764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 435/883] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:50.428230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde842-a16a-4daa-a849-e2c63690fb53 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:50.543924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde842-a16a-4daa-a849-e2c63690fb53 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:50.578380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:50.579120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.579403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.579679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.580371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:50.581749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0067ae95-446a-42f5-8ced-208bc07aa491 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:50.594404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:50.595436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:50.596298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 449/884] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:50.601752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:50.708366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13b21b-259a-47c0-9414-f2b92f39adbd None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:50.717834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73fe3-a1bf-414e-bb20-24fba3c9ad4c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.718496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73fe3-a1bf-414e-bb20-24fba3c9ad4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.718967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73fe3-a1bf-414e-bb20-24fba3c9ad4c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.720979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 450/885] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:50.726301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.726822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.727294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.744771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:50.745454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.745732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.746008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.746747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:50.747030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:50.748350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:50.748462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:50.749899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:50.753831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 436/886] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:50.759285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:50.827774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 451/887] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:50.850306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:50.876449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d54d-9f6e-4027-ac2e-ac26ab02d186 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:50.910431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:50.911132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.911415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.911722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.912445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:50.912780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:50.914168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3055-98e3-4673-ba08-129727efe29c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:50.918985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 437/888] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:50.920243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d7f9-cf8a-4707-8173-b37e61eff0f7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.920524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d7f9-cf8a-4707-8173-b37e61eff0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.920797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d7f9-cf8a-4707-8173-b37e61eff0f7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:50.922306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 438/889] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:50.927259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d7f9-cf8a-4707-8173-b37e61eff0f7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:50.957932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a93a4a-0416-4a19-86d3-7f9d2111f26b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:50.991368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:50.992283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:50.992564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:50.992887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.003235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-533e6c8f-24a6-4db2-99ea-eff28c92e122 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:51.011397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:51.012527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:51.013346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 452/890] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:24:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:51.014501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.014501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.014501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.031288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:51.032596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:51.041006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d7f9-cf8a-4707-8173-b37e61eff0f7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.076749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.077427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.077760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.078231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.079153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] RBAC: Adding query filter params (interface=public, service_id=0ba7a23361984fae8693a011d3dd5be8, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.079465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.080885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.091646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 439/891] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:24:50 2022] GET /identity/v3/endpoints?service_id=0ba7a23361984fae8693a011d3dd5be8&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.091646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.103078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 453/892] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:51.103902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.206787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a438b-1b30-4791-80c3-c14edce589f9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.208868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1c70-2857-4dc7-b344-e22e3c62138e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.242280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.242961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.243238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.243569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.244227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.244784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.245477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.245632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.245779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.246028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.246957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.247553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.249330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.255921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 454/893] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:24:51.255921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.269225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 440/894] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.275097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.365691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbc04b-d338-4390-b48e-e56ba9d7190e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.403979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.404874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.405150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.405421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.406281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.407208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914e4f-baad-4740-b432-3ee50d1e9ead None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.407842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:51.421171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:51.422362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:51.424332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 455/895] 10.222.0.79 () {56 vars in 1132 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:51.429260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.453578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.454569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.454860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.455141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.467577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.470663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:51.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:51.492257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:51.494317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:51.494317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:51.494317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:51.494317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:51.494317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 441/896] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:51.497105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.538989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381a11-d65e-4a9f-b89b-bc86168eea24 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.573897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.574958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.575463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.575957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.576877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.577385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.579153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.584562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 456/897] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.592921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.600928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98e46-7cab-49ba-bb7f-bd145d74c2ba None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.634839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.635441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.635749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.636032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.636766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.637076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.638453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ad83-29cd-41d3-8859-559789c10d3f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.650298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 442/898] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.651575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041114-d3f4-4a56-b557-07906f8eb231 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.651893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041114-d3f4-4a56-b557-07906f8eb231 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.652167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041114-d3f4-4a56-b557-07906f8eb231 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.653567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 443/899] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:51.658272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0041114-d3f4-4a56-b557-07906f8eb231 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.696961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f62c5-e6a8-4ef4-8393-4f702a70afb8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.729980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.730660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.730944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.731222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.731979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.732281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.733657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7a21e-9476-4b57-90a4-1d4a14c1e6b6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.739094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 457/900] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.740345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.740633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.740912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.757047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:51.758477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:51.763362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0041114-d3f4-4a56-b557-07906f8eb231 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.798982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.799865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.800129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.800388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.807838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.809305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:51.825377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:51.826348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:51.827314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 444/901] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:51.828001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.839786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 458/902] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:51.840746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.942948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6d64-f081-4ad5-9084-db67af6870ed None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.950047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdbaff-5472-4634-9705-89dec7d52707 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.978074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.978756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.979016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.979298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.980178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.980490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.981940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.984621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.985286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.985569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.985845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.986642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] RBAC: Adding query filter params (interface=public, service_id=5caaf370ac6c40b589b7d953ad92cf78, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:51.986952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.988387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.993527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 445/903] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/endpoints?service_id=5caaf370ac6c40b589b7d953ad92cf78&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:51.994392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.001973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 459/904] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:52.003192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.097939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852081-2770-4988-9cc5-5dcc593bbe9d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.103120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec7a8-9b52-47ac-a800-93d3063119ae None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.132541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.133507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.133942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:52.134357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:52.135258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:52.136930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:52.139339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.140113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.140995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:52.141282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:52.141981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:52.143394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:52.149646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 460/905] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:24:52 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:24:52.150512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.154588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 446/906] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:24:51 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:52.286937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889a44-084b-4ca2-9c52-1020e0cdd7af None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.333182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.333881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.334163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:52.334437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:52.409732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:52.411219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:52.518080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 461/907] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:24:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:24:52.523745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.626820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3582a-6293-43d0-9311-2213e4b5d75b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.660610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.661437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.661721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:52.662000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:52.673458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:52.674934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:52.692759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:52.693681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:52.695391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:52.695391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:52.695391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:52.695391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:52.695391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 447/908] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:52.699966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.801836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9a86-5014-47e0-8b0a-3f90e35d969d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.847720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.847720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.847720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:52.847720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:52.848159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:52.848159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:52.848159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:52.855423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 462/909] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:52.861413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:52.964114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148bb76-d1b4-4d3a-9196-df9f66651311 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:52.998421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:52.999242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:52.999680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.000050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.010260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:53.012008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:53.026519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:53.027467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:53.028421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:53.031103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 448/910] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:53.037050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:53.139415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a850fa-2ad1-4f6a-a2a8-6bffec044174 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:53.174943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:53.176084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.176571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.177057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.178064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:53.178583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:53.180302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886de39-338e-46c8-920a-3bd4ee6e24ac None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:53.193226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 463/911] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:53.199614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:53.300084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba6a0-23e7-4bff-83d8-14e6578bf39a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:53.334330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:53.335407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.335927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.336405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.337456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] RBAC: Adding query filter params (role.id=7d638d5f2ed44596b36b6cd6b5c2d83e, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e1b7478c84744e0e80ebda09dca94998) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:53.338066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:53.339761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a395d5-89fd-4ca4-a7f5-cb1aa5011f61 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:53.346132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 449/912] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:24:53 2022] GET /identity/v3/role_assignments?user.id=e1b7478c84744e0e80ebda09dca94998&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=7d638d5f2ed44596b36b6cd6b5c2d83e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:53.572831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d646-cb4e-4163-bfdd-9ac07b78fd9f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.573345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d646-cb4e-4163-bfdd-9ac07b78fd9f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.573345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d646-cb4e-4163-bfdd-9ac07b78fd9f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.574814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 464/913] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:53.580671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.581516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.582001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.599090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:53.600620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:53.667072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 450/914] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:53.690487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d646-cb4e-4163-bfdd-9ac07b78fd9f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:53.790756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d646-cb4e-4163-bfdd-9ac07b78fd9f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:53.825515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:53.826066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.826347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.826626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.827293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:53.828792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:53.840763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:53.841794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:53.843089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 465/915] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:53.850587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:53.955177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637142-6519-4d47-a3d5-6f11c4226fb5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:53.991372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:53.992474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:53.992954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:53.993449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:53.994360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:53.994873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:53.996601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.002349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 451/916] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:54.008370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.108885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6d59d-5f80-43e0-850e-88517de97856 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.142871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.143654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.143964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.144243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.144962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:54.145276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:54.146738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deefa6c-d95e-484b-8514-3e741df7b6f0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.151967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 466/917] 10.222.0.79 () {56 vars in 1114 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:54.158102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.261500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305735da-d3b1-4958-a5d3-c5ca930ce755 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.296662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.298141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.298674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.299190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.300247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:54.301976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ff3f6-10f6-482f-b846-2d48d796146e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.325899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 452/918] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:24:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:54.492369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21403-eed3-4591-be33-de0998b27a8a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.492578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21403-eed3-4591-be33-de0998b27a8a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.492855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21403-eed3-4591-be33-de0998b27a8a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.494614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 467/919] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:54.500711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.501029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.501282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.520323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:54.521522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:54.598613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4af8d-345c-4a9c-aae3-64429e6689b5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.599164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4af8d-345c-4a9c-aae3-64429e6689b5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.599164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4af8d-345c-4a9c-aae3-64429e6689b5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.600571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 468/920] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:54.604318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 453/921] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:54.606021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.606282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.606562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.624038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:54.625809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:54.627066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.695523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 469/922] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:54.720935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.738174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632d9d5-5b74-4c6e-b95d-0affb090ebb5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.781400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.782751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.783202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.783847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.785126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:54.786782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:54.802993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:54.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:54.805390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:54.808712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 454/923] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:54.814390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.832318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cd60a-478e-48cb-b363-bfe2a9e1507e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.874198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.875117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.875395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.875678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.876384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:54.878226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:54.893829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:54.894954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:24:54.895858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:54.899763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 470/924] 10.222.0.79 () {56 vars in 1132 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:54.902407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.946066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedd8a-05d1-4ead-86a5-77c4c7c0a35c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.993011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.994067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.994586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.995472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.996741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:54.997276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.000040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.007178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 455/925] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:55.007459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38cff-ce41-449b-a5ec-4c9329e928d0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.015601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.049797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.050487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.050770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.051044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.051885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:55.052101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.053475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.063606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 471/926] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:55.065153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.148192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8f57-013c-49a6-9510-60d68cb9516d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.170706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39455c-590a-48cf-9770-3a132c8982d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.182529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.183564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.183752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.184161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.184991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:55.185527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.186936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.197182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 456/927] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:55.200434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.212805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.214105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.214839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.215258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.216157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:55.216732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.219308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.231129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 472/928] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:55.232818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.325765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38edc-2039-4df1-bdbd-2d1e54105edb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.333098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7043eb-cb5f-4f26-b798-39d50c7a14fc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.361640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.362340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.362593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.362885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.363652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] RBAC: Adding query filter params (interface=public, service_id=4cd56bb5717a4df9b1bfde88ec1bc3c9, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:55.364010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.365512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.373860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.374992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 457/929] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/endpoints?service_id=4cd56bb5717a4df9b1bfde88ec1bc3c9&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:55.375372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.375894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.376018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.376568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.377519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.380057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b2dde-f8ca-4fc2-ae52-66d8baa3df9c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.407736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 473/930] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:24:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:55.497496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad625-1cc7-4f9a-8a01-4fc4876f5959 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.542345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.543133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.543598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.543905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.544827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:55.546503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf35957-48bb-42e4-980f-8ffb03c6c248 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:55.554812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 458/931] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:24:55.649837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5807-7d78-44af-bb88-eac769c64d10 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.650396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5807-7d78-44af-bb88-eac769c64d10 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.650396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5807-7d78-44af-bb88-eac769c64d10 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.652095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 474/932] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:55.657732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.658244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.658331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.677777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:55.678983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:55.752308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 459/933] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:55.774604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5807-7d78-44af-bb88-eac769c64d10 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:55.878514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5807-7d78-44af-bb88-eac769c64d10 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:55.915385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:55.916178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:55.916461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:55.916736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:55.928427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:24:55.936843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:55.937791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:55.938765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 475/934] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:55.944835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.047551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c572d-85b1-4bd2-a7ab-7cc70eb610ec None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.081498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.082188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.082466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.082734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.083485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:56.083809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.085186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.094002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 460/935] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:24:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:56.099745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.205559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10403bb3-95ed-436e-8e64-cb4a4fb796cc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.239947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.240766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.241047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.241320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.252545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.254078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:56.272202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:56.274265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:56.276599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:56.276599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:56.276599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:56.276599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:56.276599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 476/936] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:56.280858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.379773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efccced-b293-4ba2-a847-0ff8b8633ced None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.413240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.413943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.414217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.414484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.415206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:56.415515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.416930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.429690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 461/937] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:56.435146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.540277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0090-4f08-4b23-8820-52fe0b1ff106 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.574792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.575678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.575986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.576262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.584029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.585553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-1ac13f87-38ec-47d2-8971-9662d8f90d19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:24:56.600123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:56.602371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:56.604635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 477/938] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:56.607801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.707379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fd854-ca6e-40f0-94f8-2bcbe80cc3e2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.710874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ebcd-56ba-4fd9-8e28-0d8f2a34ded6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.711343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ebcd-56ba-4fd9-8e28-0d8f2a34ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.711498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282ebcd-56ba-4fd9-8e28-0d8f2a34ded6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.713081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 478/939] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:56.718522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.718979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.719344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.736701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:56.737886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:56.741268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.741959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.742238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.742511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.743447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:56.743649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.745130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.763206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 462/940] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:56.769506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.812971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 479/941] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:56.844657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.882517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafe60-0b35-441e-9c81-37c81b6ddc03 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.916824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.917646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.917928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.918204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.929112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.930643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.944722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7576f9-db8e-4f63-9b16-9cefeb872810 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:24:56.950248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:56.951154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:56.952105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:24:56.952105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:24:56.952105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:24:56.952105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:56.952105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 463/942] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:56.958944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.998248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.998973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.999273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.999759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.001067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.002985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.004714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING keystone.server.flask.common [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 14:24:57.024048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.sql.core [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:24:57.024048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 14:24:57.024048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [parameters: {'id': 'e1d3a0da58e9494bafdbcabfc7939740', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 14:24:57.024048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80037) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d3a0da58e9494bafdbcabfc7939740.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d3a0da58e9494bafdbcabfc7939740. May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:24:57.047519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 14:24:57.048983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application yield resource May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application next(self.gen) May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise self.value May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application session.commit() May 12 14:24:57.050167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.session.flush() May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application compat.raise_( May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:24:57.051301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:24:57.052465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application conn.query(q) May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application result.read() May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:24:57.053439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [parameters: {'id': 'e1d3a0da58e9494bafdbcabfc7939740', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.054595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:57.055585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1d3a0da58e9494bafdbcabfc7939740. May 12 14:24:57.057081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.059732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 480/943] 10.222.0.79 () {60 vars in 1140 bytes} [Thu May 12 14:24:56 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:57.077250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:57.078393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afb03-baca-4283-b0bb-a8f639393ac6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.122092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.123184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.123476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.123783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.125604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:57.125919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.127475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.143599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 464/944] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:57.149407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:57.184035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234c93-6ac4-43c0-b38e-1868d33d5968 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.224714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.225833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.226118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.226544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.238592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.240330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:57.256239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:57.257213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:57.258163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:57.262506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 481/945] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:57.264538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:57.274889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b7ad-cc67-4466-ab7a-1e8c16c802d0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.317700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.318548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.318828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.319099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.332039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.334291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:24:57.355119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:57.356160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:24:57.357063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:57.360449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 465/946] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:57.365907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:57.388602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912ba7-7500-462f-af7d-d3fe59f34a13 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.424771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.425458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.425742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.426044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.426788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:57.427095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.428646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.456808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 482/947] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:57.483405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc36e-17a9-4665-bb66-6fff62b3f699 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.520663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.521355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.521638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.521915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.522726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:57.523035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.524561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338e76b-af2d-434c-ab75-4d8d6dca2ba7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.538853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 466/948] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:57.545470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:57.654971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb97a6-2875-49c6-81b1-4bdafe449a0d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:57.693257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:57.694555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.695039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.695556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e1b7478c84744e0e80ebda09dca94998/roles/7d638d5f2ed44596b36b6cd6b5c2d83e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.698336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=e1b7478c84744e0e80ebda09dca94998, role_id=7d638d5f2ed44596b36b6cd6b5c2d83e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:57.700248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae91a3-6b7c-477f-b340-70ec441ef867 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:57.724004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 483/949] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:24:57 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e1b7478c84744e0e80ebda09dca94998/roles/7d638d5f2ed44596b36b6cd6b5c2d83e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:24:57.845419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e735-33bc-40cc-90ed-b48f9d57a323 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.845974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e735-33bc-40cc-90ed-b48f9d57a323 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.845974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e735-33bc-40cc-90ed-b48f9d57a323 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.847715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 467/950] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:57.853669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.854012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.854229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.872275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:57.873809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:57.903075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc493d8-a638-4b14-86f4-d9c991a6dde2 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.903385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc493d8-a638-4b14-86f4-d9c991a6dde2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.903640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc493d8-a638-4b14-86f4-d9c991a6dde2 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.906221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 468/951] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:57.911993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:57.912280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:57.912567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:57.930559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:57.931820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:57.954001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 484/952] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:24:57.977076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.011538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 469/953] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:24:58.033431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.086320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded12d-e88d-4310-83e8-dad0016fdea8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.120880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.121700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.121981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.122258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.122923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.124376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:58.137048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:58.138162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:24:58.139014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 485/954] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:24:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:24:58.145017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.162913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7c48-0bb8-418e-8691-3266a8fc3850 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.200620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.201968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.202259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.203207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.204455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.206150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:24:58.222943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:24:58.224625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:24:58.225732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 470/955] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:24:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:24:58.234428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.256531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bef7-fc72-4cf4-adfb-5ef6b6a9492e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.291928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.292701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.293054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.293403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.294183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:58.294558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.296027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.306421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 486/956] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:58.307377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.360741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0323a-5fa1-48c5-b7a5-2e2613efb17a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.403968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.404574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.404858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.405133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.406010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:58.406536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.408056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.417883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 471/957] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:58.418034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef84dc-6e35-41fc-bf37-eb4f42cabc06 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.419224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.455050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.455821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.456085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.456365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.457142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:58.457387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.458835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.472049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 487/958] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:24:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:24:58.535977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73853868-c947-470a-a90f-789bbcd32ebf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.573694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.574758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.575263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.575836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.576667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:24:58.576999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.578448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9457-e87d-4d28-8e6e-b66695b61a9e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.588774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 472/959] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:24:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:24:58.594768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:58.707340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1e28-f19c-450c-bdb7-980d698cce7a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:58.741502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:58.742268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:58.742455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:58.742723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:58.743667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:58.745074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb488a3-9852-4840-91ca-d49eb40efdbf None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:58.767529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 488/960] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:24:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:24:59.904013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9a7e-681e-4c61-83c7-567ff8c3d820 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:59.904544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9a7e-681e-4c61-83c7-567ff8c3d820 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:59.904544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9a7e-681e-4c61-83c7-567ff8c3d820 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:59.906269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 473/961] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:59.912240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f218-d5d5-484a-8416-7d1a981fb566 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:59.912908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f218-d5d5-484a-8416-7d1a981fb566 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:59.912908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f218-d5d5-484a-8416-7d1a981fb566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:59.931848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-73f2f218-d5d5-484a-8416-7d1a981fb566 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:59.933067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-73f2f218-d5d5-484a-8416-7d1a981fb566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:00.009872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 489/962] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:24:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:00.035362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b9a7e-681e-4c61-83c7-567ff8c3d820 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.134752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795da00-c1d9-41d4-bc58-6112d1b7983f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.135040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795da00-c1d9-41d4-bc58-6112d1b7983f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.135323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795da00-c1d9-41d4-bc58-6112d1b7983f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.135832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b9a7e-681e-4c61-83c7-567ff8c3d820 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.137002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 490/963] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:00.141994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.142283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.142569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.159480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:00.160691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:00.178446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.179359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.179825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.180270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.181541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.183412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.185644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING keystone.server.flask.common [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 14:25:00.201754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.sql.core [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:25:00.201754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 14:25:00.201754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [parameters: {'user_id': '04ac3e5f86004e7b9f3c105a382a0ade', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 14:25:00.201754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80038) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 12 14:25:00.212254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:25:00.213306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application yield resource May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application next(self.gen) May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise self.value May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application session.commit() May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:25:00.214497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.session.flush() May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application compat.raise_( May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:25:00.215605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:25:00.220032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application conn.query(q) May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application result.read() May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:25:00.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [parameters: {'user_id': '04ac3e5f86004e7b9f3c105a382a0ade', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:00.221741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 14:25:00.222521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.223466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 474/964] 10.222.0.79 () {60 vars in 1131 bytes} [Thu May 12 14:25:00 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:00.225297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.244084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 491/965] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:00.263641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.346046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da42640-b09d-4e77-85a5-a3d1b046a3cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.368527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f8e7f-6e2f-4b3e-9489-fbf6b70e8f41 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.390710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.392193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.392912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.393333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.404192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.405413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.406365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.406730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.406845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.407206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.418727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:25:00.424788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:00.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:25:00.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:00.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:00.435101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:00.436023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:00.436774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 475/967] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:00.437253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 492/967] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:00.438126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.438258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.541734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfe29b-cdf1-401d-81d7-a0e687fb56aa None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.549703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb5d0-53c8-47b1-9069-822c5fdc137c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.579268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.580300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.580895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.581303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.582271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:00.582640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.584363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.585615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.586382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.586738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.587089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.588034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:00.588408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.589917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.598214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 493/968] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:00.599171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.632369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 476/969] 10.222.0.79 () {56 vars in 1101 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:00.716470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdefa26-3a07-43b1-b661-2ea07afb83d5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.760095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.760989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.761270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.761543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.773822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.775325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-28b5a6e3-b3ff-484a-904d-bccf609faba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:00.794025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:00.796305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:00.798233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:00.798233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:00.798233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:00.798233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:00.798233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 494/970] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:00.801816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.850025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c4ca-95ea-4006-9aa2-411da35c5717 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.850308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c4ca-95ea-4006-9aa2-411da35c5717 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.850694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c4ca-95ea-4006-9aa2-411da35c5717 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.852680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 495/971] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:00.859819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.859819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.860140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.882362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:00.883457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:00.941175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ee5e-a7b3-4848-8da9-5e424d772b2c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:00.970804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 496/972] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:00.979453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:00.980192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:00.980473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:00.980747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:00.981477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:00.981780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:00.983162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:00.998926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:00.999134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 477/973] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:01.000205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.094647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20315a-e9c1-4cee-9ea2-c1fae8e1d8eb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.098953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b319-2df1-4eb8-8f3a-5846df0f5ac4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.127952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.128620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.128895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.129173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.129890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.131270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb9640-8aff-499f-b4f2-ff9cc61c133d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.132352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.133152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.133426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.133693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.141778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.143314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.146233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 497/974] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:25:00 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:01.147520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5da3-d200-40aa-bd61-4b051b6d258c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.147856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5da3-d200-40aa-bd61-4b051b6d258c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.148124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5da3-d200-40aa-bd61-4b051b6d258c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.151731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 498/975] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:01.155349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.155709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.156004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:25:01.160882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:01.161897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:01.162887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 478/976] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:25:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:01.168260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.179600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:01.181382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:01.265138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 499/977] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:01.278913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d375b2c-e474-4c2a-ba73-d76914384b97 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.288587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.320079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.320788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.321072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.321537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.322201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:01.322511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.324011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.342694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 479/978] 10.222.0.79 () {56 vars in 1149 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:01.349942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.394348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafcb03-8f20-4164-a138-9dd7c3273fda None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.428686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.429546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.429827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.430101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.430758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.432206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:01.444930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:01.446028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:01.446923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 500/979] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:01.452204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.459755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50508dc-a1cb-4ae2-b2e5-9be05bba5fe2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.494937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.495905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.496187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.496459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.555229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959d10-d469-4e1b-896a-7512ae63a993 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.566630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.568143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.589003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.589683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.589968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.590240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.590949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:01.591255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.592638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.598170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 501/980] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:01.603647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.668877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 480/981] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:01.674845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.704972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6577d-ebdf-4538-a67b-5deacd75bbab None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.741317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.741992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.742276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.742552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.743269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:01.743569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.745053 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.750017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 502/982] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:01.755590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.773785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dd704-3548-4860-a2b9-545058dceb21 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.807294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.808063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.808342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.808613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.818344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.819816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:01.839079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:01.840096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:01.841005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:01.841005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:01.841005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:01.841005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:01.841863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 481/983] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:01.847717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.862520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36762655-1075-47b9-b1d9-0dae3939007b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.895698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.896404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.896693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.896968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.897771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] RBAC: Adding query filter params (interface=admin, service_id=4cd56bb5717a4df9b1bfde88ec1bc3c9, region_id=RegionOne) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:01.898082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.899462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.904394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 503/984] 10.222.0.79 () {56 vars in 1249 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/endpoints?service_id=4cd56bb5717a4df9b1bfde88ec1bc3c9&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:01.910112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.958225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c69a-1f0c-4603-9cd8-3a47172e8931 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.991735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.992418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.992700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.992977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.993700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:01.994005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.995382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:02.004344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fb67-eaa2-4d62-9a7c-e712d97fb799 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:02.011320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 482/985] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:02.012666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:02.037328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:02.038006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:02.038284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:02.038560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:02.039246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:02.040651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:02.047038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 504/986] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:25:02.116969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6264c8-71c5-46df-a092-aa558acf60cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:02.154839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:02.155923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:02.156380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:02.156770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:02.164356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:02.165840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:25:02.181397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:02.182402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:02.188643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 483/987] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:02.189147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:02.291004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc41f7-1a9a-4df9-935d-f5fc03916683 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:02.326863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:02.327579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:02.327865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:02.328159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:02.328950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:02.329263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:02.330708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499e3c-6d82-45d0-8d0f-69a92a0c9697 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:02.347989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 505/988] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:02.349795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:02.448215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487e2a-b4f7-412a-8d36-70af7ac05282 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:02.482741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:02.483402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:02.483680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:02.484006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:02.484837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] RBAC: Adding query filter params (role.id=7d638d5f2ed44596b36b6cd6b5c2d83e, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e1b7478c84744e0e80ebda09dca94998) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:02.485148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:02.486572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7caa-c52a-4a15-8a05-727e11a873ed None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:02.499783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 484/989] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:02 2022] GET /identity/v3/role_assignments?user.id=e1b7478c84744e0e80ebda09dca94998&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=7d638d5f2ed44596b36b6cd6b5c2d83e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:03.399746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731e9a-899b-4574-b086-e0b330465737 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.400308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731e9a-899b-4574-b086-e0b330465737 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.400308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731e9a-899b-4574-b086-e0b330465737 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.401869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 506/990] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:03.407849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4049b-ee98-462e-a354-510257272498 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.408281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4049b-ee98-462e-a354-510257272498 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.408382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4049b-ee98-462e-a354-510257272498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.426862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fcb4049b-ee98-462e-a354-510257272498 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:03.428429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fcb4049b-ee98-462e-a354-510257272498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:03.497708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 485/991] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:03.520916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731e9a-899b-4574-b086-e0b330465737 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:03.626742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731e9a-899b-4574-b086-e0b330465737 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:03.661649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:03.662376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.662653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.662920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.663574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:03.664996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:03.677314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:03.678356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:03.679220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 507/992] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:03.685998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4049b-ee98-462e-a354-510257272498 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:03.785563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4049b-ee98-462e-a354-510257272498 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:03.824860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:03.825565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.825849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.826126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.826912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:03.827299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:03.829281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:03.839304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 486/993] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:25:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:03.840780 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:03.943840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d822-c9c1-40c5-ab84-11db993afc82 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:03.978421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:03.979145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.979433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.979674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.980488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:03.980817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:03.982183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:03.987856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 508/994] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:25:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:03.993731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.101407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef55490-1120-4c52-a6bc-83ce0ad5a10b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.137103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.137795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.138063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.138339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.139129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] RBAC: Adding query filter params (interface=public, service_id=03473c6c0dce4817b5867bf7856fc66e, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:04.139439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.140925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5ab2-32c7-4721-a8c0-10f9dbbc55af None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.146401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 487/995] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:25:03 2022] GET /identity/v3/endpoints?service_id=03473c6c0dce4817b5867bf7856fc66e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:04.151789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.252672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836ff7-7f72-4c64-a7b4-729cfdad1a1d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.263071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e3c1-7c4c-4a4e-9ab0-ae3ea56410f3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.263356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e3c1-7c4c-4a4e-9ab0-ae3ea56410f3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.263634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e3c1-7c4c-4a4e-9ab0-ae3ea56410f3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.265163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 488/996] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:04.270609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.270895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.271171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.287394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.288116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.288397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.288514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:04.288674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.289356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.289589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:04.290733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.307777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 509/997] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:25:04 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:25:04.361659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 489/998] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:04.384592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.490588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea7bd-1852-45cd-ad9a-68d48439b5a4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.523917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.524683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.524970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.525246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.525919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.527338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:04.540618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:04.541675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:04.542931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 510/999] 10.222.0.79 () {56 vars in 1126 bytes} [Thu May 12 14:25:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:04.551399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.651543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f245f0-10e2-4439-bda0-e67ae8aacce6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.687292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.688014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.688298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.688577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.689292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:04.689602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.690989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457505a-916f-4217-8557-c2a699dbd89c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.696295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 490/1000] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:25:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:04.701861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.731201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004bdab-7ced-4fc8-90bb-98f3f82153c7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.731470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004bdab-7ced-4fc8-90bb-98f3f82153c7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.731792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004bdab-7ced-4fc8-90bb-98f3f82153c7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.733166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 491/1001] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:04.738097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.738378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.738675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.759455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:04.760655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:04.800379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7014e-5db6-4a86-9e26-d828e9590783 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.828017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 492/1002] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:04.840577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.841267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.841548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.841824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.842552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:04.842898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.844489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.854211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 511/1003] 10.222.0.79 () {56 vars in 1122 bytes} [Thu May 12 14:25:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:04.854367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.854987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:04.947485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e01ae4-5941-46f8-8ba0-6f5f9a5e7739 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.950322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21b0d-a909-4b05-99a2-4ae3cebc4db3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:04.981573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.981936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:04.982381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.982486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:04.982653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.982749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:04.982919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] PATH_INFO: `/v3/services/image` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.983022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:04.983720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.983841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:04.985211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.985325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:04.996847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:04.997918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:04.998771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 493/1004] 10.222.0.79 () {56 vars in 1105 bytes} [Thu May 12 14:25:04 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:05.012017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 512/1005] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:25:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:05.012226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:05.125481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae901-3f84-42b8-a65e-91edb8685c57 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:05.171569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:05.172295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:05.172577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:05.173166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:05.173962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] RBAC: Adding query filter params (name=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:05.174271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:05.175734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3bcc6-8bb0-4f57-9e44-f89b5ff13234 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:05.185889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 494/1006] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:05.187270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:05.289630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b9f3-3571-4e94-9c53-e9962bb1baa3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:05.323131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:05.323873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:05.324153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:05.324432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:05.325161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:05.325464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:05.326849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d0caa-5228-479d-a6ad-1554e9ae0ea5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:05.331767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 513/1007] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:06.558148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913573-3f41-40f9-b534-353d3b132afe None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.558732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913573-3f41-40f9-b534-353d3b132afe None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.558732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd913573-3f41-40f9-b534-353d3b132afe None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.560339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 495/1008] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:06.566038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.566514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.566598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.584603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:06.585797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:06.658940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 514/1009] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:06.683028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd913573-3f41-40f9-b534-353d3b132afe None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:06.794671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd913573-3f41-40f9-b534-353d3b132afe None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:06.829374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:06.830216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.830495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.830768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.831466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:06.832929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:06.850121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:06.851191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:06.857406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 496/1010] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:06.860051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:06.960943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664b6ae-b6c4-4e9e-a558-1331765b0a61 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:06.995795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:06.996489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.996769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.997039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.997747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:06.998049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:06.999614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.004915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 515/1011] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:25:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:07.010479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:07.111281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e832eb-3914-40ef-be94-f5e8a0464e5f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:07.151005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:07.151810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.152042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.152314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.153031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:07.153339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:07.154726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b7c5-15a6-455e-8cf8-ea5191aa59a6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.160766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 497/1012] 10.222.0.79 () {56 vars in 1112 bytes} [Thu May 12 14:25:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:07.166352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:07.264963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bedcc-10c7-4690-a209-f3f4d2d55a3d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:07.299395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:07.300095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.300376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.300651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.301401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:07.302773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.314562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ac87-6e91-4831-80b9-56c0cc50da66 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.314848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ac87-6e91-4831-80b9-56c0cc50da66 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.315321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ac87-6e91-4831-80b9-56c0cc50da66 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.316715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 498/1013] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:07.321593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425c08-35c9-4bc6-abbb-fdc927849567 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.321882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425c08-35c9-4bc6-abbb-fdc927849567 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.322162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425c08-35c9-4bc6-abbb-fdc927849567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.327749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 516/1014] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:25:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:07.340881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-80425c08-35c9-4bc6-abbb-fdc927849567 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:07.342135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80425c08-35c9-4bc6-abbb-fdc927849567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:07.429610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 499/1015] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:07.454109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:07.563864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd5e-1462-4f0f-8170-d6cefa9d3cda None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:07.598895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:07.599805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.600086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.600356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.600621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8596-159d-4090-b9b3-6e447774d47e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.601022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8596-159d-4090-b9b3-6e447774d47e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.601166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8596-159d-4090-b9b3-6e447774d47e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.601532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:07.602619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 500/1016] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:07.602988 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.604971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 517/1017] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:07.608164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.608558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.608930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.611455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:07.630186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:07.630186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:07.698790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 501/1018] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:07.712750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080484d-564e-420a-a672-7fc37f2de813 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:07.722398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:07.747034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:07.747757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.748049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.748324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.749155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:07.750657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072c10-ba44-4264-a305-a8143d924ec3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.779348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 518/1019] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:25:07 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:07.830520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7906-c35b-41f8-b02d-2b2e778b8d67 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:07.871206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:07.871962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:07.872246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:07.872522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:07.873298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:07.874893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5906-d1d5-4c54-84fa-bbf618d34bb0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:07.897157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 502/1020] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:25:07 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:09.668267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608986fd-e816-4f2a-a186-ee949423ee22 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:09.668829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608986fd-e816-4f2a-a186-ee949423ee22 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:09.668829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608986fd-e816-4f2a-a186-ee949423ee22 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:09.670342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 519/1021] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:09.676191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:09.676638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:09.676713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:09.694171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:09.695372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:09.768966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 503/1022] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:09.792041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608986fd-e816-4f2a-a186-ee949423ee22 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:09.891575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608986fd-e816-4f2a-a186-ee949423ee22 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:09.925065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:09.925821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:09.926107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:09.926350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:09.939464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:09.948208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:09.950013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:09.950877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:09.953613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 520/1023] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:25:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:09.957209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.059843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948b20-ed18-4050-866e-39a1aa9a27de None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.093314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.093999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.094251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.094545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.095289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:10.095587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.096997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30f1d8-3a6a-41fa-841c-b29e68d5ee14 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.105599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 504/1024] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:25:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.111450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.135751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d664bf-e7c7-4e74-8b2d-822ca124c655 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.136142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d664bf-e7c7-4e74-8b2d-822ca124c655 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.136428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d664bf-e7c7-4e74-8b2d-822ca124c655 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.137941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 505/1025] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:10.140617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae978c-dd7e-4297-baaf-664ac2969179 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.140915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae978c-dd7e-4297-baaf-664ac2969179 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.141194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae978c-dd7e-4297-baaf-664ac2969179 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.142577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 506/1026] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:10.144853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeea-1388-4355-ae49-9fda53164a34 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.145122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeea-1388-4355-ae49-9fda53164a34 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.145402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeea-1388-4355-ae49-9fda53164a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.162220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-206fbeea-1388-4355-ae49-9fda53164a34 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:10.163420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-206fbeea-1388-4355-ae49-9fda53164a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:10.212007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087aeb0-f0ae-4b3d-a27d-7132c863fcc6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.231572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 507/1027] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:10.232916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.233200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.233649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.248413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.249833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.250126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.250403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.250958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:10.252201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:10.262124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.263601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:10.282034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:10.283028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 521/1028] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:10.284044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.320068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 508/1029] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:10.320912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.379773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf645f-55a0-441a-ad18-b9d39205214d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.412340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.413140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.413412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.413678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.414877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.416345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.417961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 522/1030] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.418716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.420128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde5f0-3dc0-4dda-b240-03e07c0d7037 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.455202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.455915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.456205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.456483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.457215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:10.457520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.458916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.475158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 509/1031] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.475158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.518612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9aea5-457c-444c-ba0e-140bb6652d49 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.551017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.551839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.552117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.552380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.553030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.554374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:10.565925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:10.567009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:10.567914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 523/1032] 10.222.0.79 () {56 vars in 1105 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:10.568728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.572247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5d9f-9226-40be-aa76-14e43f0a595a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.606381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.607039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.607316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.607588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.608349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.609783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.631659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 510/1033] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:25:10 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:10.632493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.670210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be263359-6036-4544-b7e0-48b09423b5b8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.708429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.709323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.709591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.709862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.719321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.721156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:25:10.736854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:10.737907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:10.738886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:10.743219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 524/1034] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:10.744205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.744440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e3f8-3aaf-428b-9b2e-9540b29cacbd None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.781210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.781789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.782162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.782524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.783349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:10.783787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.785278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.795658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 511/1035] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.796886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.855453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695baaa-e4ee-4402-81c8-2e75336a9321 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.889232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.890411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.890411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.890637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.891490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:10.891845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.893277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.901767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736abe-44f1-4b17-a0d9-55ea78e0b6e0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:10.912587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 525/1036] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.918576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:10.934849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:10.935820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:10.936256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:10.936826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:10.937682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] RBAC: Adding query filter params (type=image) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:10.938136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:10.939505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:10.949777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 512/1037] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:10.951357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.017307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57537e1-9144-4ad7-ba54-b49e6df64c15 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.051610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.051890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3f212-9968-4005-9c74-61b166d0fe09 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.052491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.052834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.053169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.085315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.086077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.086429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.086770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.087603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] RBAC: Adding query filter params (interface=public, service_id=9564a1e1f0604cf8a761e69422f14e3b, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:11.088028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.089509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.094829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 513/1038] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/endpoints?service_id=9564a1e1f0604cf8a761e69422f14e3b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:11.100324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.121649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.123119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.195430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5fe7-229e-4a92-8b06-aae9975eb2c8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.219610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 526/1039] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:25:11.225088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.228820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.229683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.230058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.230426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.231205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.232686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.239601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 514/1040] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/services => generated 1957 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:25:11.327612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bdd28-4f00-4363-ae56-05413d4315ce None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.364378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.365307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.365653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.365991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.377908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.379516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:11.398882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:11.400155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:11.401280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:11.401280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:11.401280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:11.401280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:11.404158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 527/1041] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:11.407805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.507774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f00f-9ebe-4551-9a65-862ea09e2a9a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.542550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.543283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.543574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.543877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.544600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:11.544906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.546439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.563732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 515/1042] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:11.565001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.666284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f1e3a-848a-4bd5-9523-f59b9b54d684 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.701584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.703064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.703347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.703629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.710474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.711947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:25:11.725918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:11.726788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:11.727675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 528/1043] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:11.733091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:11.841737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb98d-c93c-40b9-a2b1-7dd0691c7ae8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:11.880999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:11.881681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:11.881954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:11.882221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:11.883005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:11.883307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:11.884760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3012a-36ef-4329-9474-8cbe2bb0d9f3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:11.901872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 516/1044] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:11.903154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:12.010821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68228e8-99ae-4d44-acc8-0b376eff7d71 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:12.044725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:12.045385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:12.045664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:12.046020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:12.046851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] RBAC: Adding query filter params (role.id=7d638d5f2ed44596b36b6cd6b5c2d83e, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:12.047152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:12.048949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8a73-4bf0-4f8e-97ae-11edc5e2c6b4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:12.054476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 529/1045] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:11 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=7d638d5f2ed44596b36b6cd6b5c2d83e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:12.921108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08c63-5280-4d04-b91e-da26c8f475b5 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:12.921672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08c63-5280-4d04-b91e-da26c8f475b5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:12.921672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08c63-5280-4d04-b91e-da26c8f475b5 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:12.923674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 517/1046] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:12.928965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:12.929376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:12.929545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:12.947182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:12.948356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:13.015726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 530/1047] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:13.038654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08c63-5280-4d04-b91e-da26c8f475b5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.142450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08c63-5280-4d04-b91e-da26c8f475b5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.177267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.181588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.181588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.181588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.193383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:13.201124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:13.202692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:13.204122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:13.207979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 518/1048] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:13.208905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.314355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102525c-4350-49b1-a3fc-53a8ff6d8875 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.348724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.349405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.349683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.349952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.350703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:13.351004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.352428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f7868-848a-4ae5-828e-12c1cc66a01c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.360730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 531/1049] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:13.366336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.463966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc116b-f6a5-482a-a759-31a9114d850e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.464153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc116b-f6a5-482a-a759-31a9114d850e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.464416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc116b-f6a5-482a-a759-31a9114d850e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.465943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 532/1050] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:13.466952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3315c5-236e-491e-aa8c-b7c0b6155e6f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.470840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.471126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.471401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.488351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:13.489536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:13.501275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.502163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.502440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.502710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] PATH_INFO: `/v3/users/539e4b7f5ff2401aabea8f291624103b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.516065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] RBAC: Authorizing `identity:get_user(user_id=539e4b7f5ff2401aabea8f291624103b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.517551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.519447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 519/1051] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/users/539e4b7f5ff2401aabea8f291624103b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:13.525093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.556260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 533/1052] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:13.578666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.624123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f026309-d305-495f-a947-1163d05d0adf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.657206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.657874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.658155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.658451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.677151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9b28-713f-4455-93c6-6c5a17048f24 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.710276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.711099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.711384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.711659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] PATH_INFO: `/v3/services/image` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.712349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.713737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.723337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.724872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:13.725786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:13.726757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:13.732562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 534/1053] 10.222.0.79 () {56 vars in 1105 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:13.734848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.822815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 520/1054] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:13.828679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.838351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978314-781a-4bd5-8a93-b531c6e90673 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.871372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.872113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.872390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.872663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.873372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] RBAC: Adding query filter params (name=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:13.873672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.875256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.880282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 535/1055] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:13.885869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.926322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3efbc-8124-48fd-99da-d409e2e65057 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:13.962541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:13.963429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:13.963726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:13.964004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:13.965195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:13.966639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:13.968403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 521/1056] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:13.974517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:13.986161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d142-0818-436e-9415-f504c840526f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.019630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.020326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.020603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.020871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.021579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] RBAC: Adding query filter params (type=image) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:14.021880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:14.023260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:14.028275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 536/1057] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:14.033841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:14.070391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b917b1-59f7-4cbe-8253-3df1dad4d48a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.104960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.105641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.105917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.106187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.107030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=069d2d9519474d82a5dd07416ee04b75, user.id=539e4b7f5ff2401aabea8f291624103b) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:14.107338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:14.108914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd34b3-f08f-42a3-83b7-d0f6a4b4d93e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:14.123989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 522/1058] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:13 2022] GET /identity/v3/role_assignments?user.id=539e4b7f5ff2401aabea8f291624103b&scope.project.id=069d2d9519474d82a5dd07416ee04b75&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:14.139035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4642-2496-4d50-9902-1d4919557e17 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.174791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.175481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.175792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.176069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.176838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:14.178264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0c6f-1a0e-4ae0-a074-9ea304a9afd4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:14.198652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 537/1059] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:25:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:14.290352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54dba-688f-4d98-8f79-82b827e0faa3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.290548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54dba-688f-4d98-8f79-82b827e0faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.290797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c54dba-688f-4d98-8f79-82b827e0faa3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.292502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 523/1060] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:14.299350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.299609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.299900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.318990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:14.320209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:14.402534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 538/1061] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:14.425918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c54dba-688f-4d98-8f79-82b827e0faa3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:14.529141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c54dba-688f-4d98-8f79-82b827e0faa3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.563060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.563844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.564121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.564392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.574911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:14.583262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:14.584346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:14.585233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:14.586490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 524/1062] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:25:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:14.591183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:14.690103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665102-dd97-4d33-8a7d-db1dea9ffd80 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.724504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.725188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.725449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.725732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.726478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:14.726782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:14.728183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:14.741734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 539/1063] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:25:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:14.743345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:14.844155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd811-237e-4058-b9b8-f4e4f7cfe511 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:14.878471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:14.879306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:14.879580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:14.879882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:14.890806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:14.892299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:14.909395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:14.910387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:14.916627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:14.916627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:14.916627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:14.916627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:14.916627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 525/1064] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:14.918446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.020583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e24c4-bbc3-404c-bcfd-7c403a3617ea None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.054299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.054995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.055276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.055552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.056345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:15.056650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.058028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.070401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 540/1065] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:15.076430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.177097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9d4bd-dfca-4188-be0e-5dc717924ded None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.209968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.210776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.211053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.211325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.219681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.221159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:25:15.234993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:15.236008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:15.236944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:15.239793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 526/1066] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:15.242387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.342520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3db6a3-a9c5-47b9-bc7d-797d1a6a8b65 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.378625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.379320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.379596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.379894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.380745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:15.381046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.382473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.400330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 541/1067] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:15.405863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.506638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384448-63e7-4e66-ba7d-0919e39814e7 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.540948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.541822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.542100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.542374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.553863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.555377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:15.572312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:15.573292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:15.579472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:15.579472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:15.579472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:15.579472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:15.579472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 527/1068] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:15.579798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.679357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d0d1f-8778-470c-aeea-62d3af503251 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.715129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.715816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.716096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.716372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.717177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:15.717371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.719159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.730795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 542/1069] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:15.736707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:15.849874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b5c7d-7ef2-43f1-9808-1f205f1d7334 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:15.884307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:15.885517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:15.885935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:15.886381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:15.893428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:15.895056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:25:15.909500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:15.910477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:15.911362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:15.915901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 528/1070] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:15.917488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.019470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab02b8-3477-43e8-939f-efaa81cc29ba None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.053563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.054916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.055341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.055782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.056739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:16.057192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:16.058776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b049-9485-4d33-8ad3-de4d89600ba1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:16.071444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 543/1071] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:16.077654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.181015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed12ad7-65ee-45fb-a072-375219366037 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.218745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.219659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.219985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.220203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/7d638d5f2ed44596b36b6cd6b5c2d83e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.222506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=e2801984340040c499b17ef6e0324033, role_id=7d638d5f2ed44596b36b6cd6b5c2d83e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:16.223995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6a60-72d2-4b6f-9719-397698b157b7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:16.238565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 529/1072] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:25:16 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/e2801984340040c499b17ef6e0324033/roles/7d638d5f2ed44596b36b6cd6b5c2d83e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:25:16.366365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f58-44db-4e12-91eb-0f2f2a746cdc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.366604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f58-44db-4e12-91eb-0f2f2a746cdc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.366890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f58-44db-4e12-91eb-0f2f2a746cdc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.368518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 544/1073] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:16.374292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305017ba-d807-4057-9136-96eace40bb1c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.374607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305017ba-d807-4057-9136-96eace40bb1c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.374848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305017ba-d807-4057-9136-96eace40bb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.393436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-305017ba-d807-4057-9136-96eace40bb1c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:16.394686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-305017ba-d807-4057-9136-96eace40bb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:16.475177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 530/1074] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:16.498536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a56ad-5fab-4227-846b-00deb31a9d65 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.498783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305017ba-d807-4057-9136-96eace40bb1c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.498906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a56ad-5fab-4227-846b-00deb31a9d65 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.499172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a56ad-5fab-4227-846b-00deb31a9d65 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.500701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 545/1075] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:16.506418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.506705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.506981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.524074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:16.525258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:16.591148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 546/1076] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:16.595234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305017ba-d807-4057-9136-96eace40bb1c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.613653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.630175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.630964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.631281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.631649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.641984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:16.649584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:16.650544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:16.657095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 531/1077] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:16.659172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.714693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cad40-0345-4af5-bb8b-07befa824c48 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.748988 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.749676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.749955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.750229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.768198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ccae-a737-4123-b4f6-cb857a1e582c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.801475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.802160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.802442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.802715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.803482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:16.803806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:16.805188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:16.818386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 532/1078] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:16.821818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.821928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:16.823176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:16.923553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 547/1079] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:25:16.929448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:16.930833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4851b-0f14-4601-a053-e7d6c5829a75 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:16.964552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:16.965451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:16.965729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:16.966000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] PATH_INFO: `/v3/users/539e4b7f5ff2401aabea8f291624103b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:16.967193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] RBAC: Authorizing `identity:get_user(user_id=539e4b7f5ff2401aabea8f291624103b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:16.968833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:16.970645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 533/1080] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/users/539e4b7f5ff2401aabea8f291624103b => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:16.975990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:17.027429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1571f23-c6ef-4424-8482-327538a63ea0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:17.065114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:17.065928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:17.066187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:17.066455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:17.074433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28516-28cd-43b3-a138-bd83188a3913 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:17.076472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:17.078430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:17.095712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:17.096692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:17.097619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:17.097619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:17.097619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:17.097619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:17.097619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 548/1081] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:17.102769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:17.112348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:17.113564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:17.113855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:17.114130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:17.115536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:17.117415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:17.125237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 534/1082] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:16 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:17.126436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:17.204351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e398-7ad2-43ce-a5fc-8b2ea39d6843 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:17.232247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08655-3d1f-43f2-b2ea-e3abcc428355 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:17.237859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:17.238538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:17.238828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:17.239103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:17.239860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:17.240171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:17.241543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23db89b-7da1-4e09-b2db-d0db44cf962d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:17.263714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 549/1083] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:17.278255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:17.279184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:17.279460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:17.279758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75/users/539e4b7f5ff2401aabea8f291624103b/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:17.282400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] RBAC: Authorizing `identity:create_grant(project_id=069d2d9519474d82a5dd07416ee04b75, user_id=539e4b7f5ff2401aabea8f291624103b, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:17.283919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb0f97-3100-4783-9beb-2fda3e741a62 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:17.302195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 535/1084] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:25:17 2022] PUT /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75/users/539e4b7f5ff2401aabea8f291624103b/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:25:18.493751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc63b4-f7b3-46f5-8aa7-8801a1273d26 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:18.494335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc63b4-f7b3-46f5-8aa7-8801a1273d26 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:18.494335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc63b4-f7b3-46f5-8aa7-8801a1273d26 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:18.495656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 550/1085] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:18.501315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:18.501726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:18.501894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:18.519728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:18.520942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:18.591924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 536/1086] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:18.615302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc63b4-f7b3-46f5-8aa7-8801a1273d26 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:18.719253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc63b4-f7b3-46f5-8aa7-8801a1273d26 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:18.752617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:18.753368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:18.753645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:18.753920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:18.764604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:18.772721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:18.773742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:18.774636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 551/1087] 10.222.0.79 () {56 vars in 1120 bytes} [Thu May 12 14:25:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:18.780449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:18.883874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a4171-5482-41a6-b0f8-a5c4b25533fa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:18.919334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:18.920064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:18.920329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:18.920629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:18.921766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:18.922078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:18.923860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:18.931879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 537/1088] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:25:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:18.938003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.041015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255a349-449e-4d5f-8af6-04119e2fcb39 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.076863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.077638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.077945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.078218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.088872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.090324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:19.107396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:19.109242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:19.110212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:19.110212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:19.110212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:19.110212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:19.110212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 552/1089] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:19.114517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.215518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690fd2d-c1b0-4d70-a137-c6bc7be65a80 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.249538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.250198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.250470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.250753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.251490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:19.251813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.253190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.265425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 538/1090] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:19.271171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.377608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665ad0-bbb6-415a-82ef-7b37670554d4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.412415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.413210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.413493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.413767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.422264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.424125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-0d30a973-05b4-4111-981a-7e619b07153d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:25:19.438376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:19.439369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:19.440474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 553/1091] 10.222.0.79 () {56 vars in 1093 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:19.445695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.526897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edacce-31a3-448a-88bb-d945217bcc7c None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.527474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edacce-31a3-448a-88bb-d945217bcc7c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.527474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edacce-31a3-448a-88bb-d945217bcc7c None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.528783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 554/1092] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:19.534082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.534429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.534763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.546837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43416a-050a-46c0-955f-75b299a640f2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.551525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:19.552722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:19.580878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.581557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.581834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.582101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.582939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:19.583244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.584720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.604490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 539/1093] 10.222.0.79 () {56 vars in 1133 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:19.606977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.618503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 555/1094] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:19.642319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.708026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a7d8-83b3-4191-a310-81df72d1a42f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.742214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.742886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.743158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.743426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.744208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ebbab-6f46-49d5-84ad-a894138d5fab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.776219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.777037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.777314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.777585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.787755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:19.795406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:19.796390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:19.797232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 556/1095] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:19.803445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.814955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.816456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.900252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72897d88-38e0-4930-8ec7-2e574fa88954 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:19.915053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 540/1096] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:25:19.920808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:19.935631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:19.936497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:19.936779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:19.937057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:19.937808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:19.938113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:19.939488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:19.947632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 557/1097] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:19.953940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.015752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776e2-850d-418f-aa56-d93f360cfeaf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.052705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8f732-3203-47a2-bf71-c8a5e72cd1af None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.056695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.057525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.057797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.058066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.067997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.069454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.086624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:20.086792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:20.087658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:20.088589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:25:20.088589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:20.088589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:25:20.088589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:20.088826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.088826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.088826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] PATH_INFO: `/v3/users/539e4b7f5ff2401aabea8f291624103b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.089011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 541/1098] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:20.089225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] RBAC: Authorizing `identity:get_user(user_id=539e4b7f5ff2401aabea8f291624103b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.090689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.092340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 558/1099] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:19 2022] GET /identity/v3/users/539e4b7f5ff2401aabea8f291624103b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:20.093548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.097880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.186576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d4cf9-9594-4a7f-89a4-9a0f76a779b1 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.196262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e74a-6ce6-472d-9eb2-5e522db8eacc None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.220388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.221041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.221326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.221609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.222335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:20.222641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.224040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.229550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.230199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.230478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.230869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.235282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 542/1100] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:20.240879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.297007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.298820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.337575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacbafc-4400-4026-823a-03c74c5e610b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.370980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.371823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.372104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.372371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.379330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.380816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.395219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 559/1101] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:25:20.395369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:20.396389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:20.397286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 543/1102] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:25:20.401006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.402007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.496689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0fada-fff3-4711-acd1-e0b4106cd951 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.497501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f73417-e4d1-438d-9207-eb08a6d01009 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.530455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.531119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.531375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.531479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.531992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.532348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.532444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:20.532629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.532722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.532901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.534113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.534214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.535531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.537270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 560/1103] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:20.543171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.546247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 544/1104] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:20.552664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:20.636103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559af7-a955-4a8b-a591-3d0969ea352f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.650593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c9eb9-4b0d-47bb-8cda-791b87cc4389 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:20.670001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.670718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.671001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.671333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.672199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=069d2d9519474d82a5dd07416ee04b75, user.id=539e4b7f5ff2401aabea8f291624103b) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:20.672513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.674297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acd1e5-7174-4aef-8cb0-b9310cd18098 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.680322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 561/1105] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/role_assignments?user.id=539e4b7f5ff2401aabea8f291624103b&scope.project.id=069d2d9519474d82a5dd07416ee04b75&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:20.685756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:20.686502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:20.686774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:20.687055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:20.687944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] RBAC: Adding query filter params (role.id=7d638d5f2ed44596b36b6cd6b5c2d83e, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=e2801984340040c499b17ef6e0324033) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:20.688253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:20.689759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fce4-39a0-4bcb-96f1-26d5aca6dae1 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:20.696755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 545/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:20 2022] GET /identity/v3/role_assignments?user.id=e2801984340040c499b17ef6e0324033&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=7d638d5f2ed44596b36b6cd6b5c2d83e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:22.947322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6365b-67ff-45ef-8a15-6b962f6f5985 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:22.947963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6365b-67ff-45ef-8a15-6b962f6f5985 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:22.947963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6365b-67ff-45ef-8a15-6b962f6f5985 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:22.949258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 562/1107] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:22.956450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:22.956914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:22.957076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:22.985138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:22.986323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:23.057218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 546/1108] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:23.090003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6365b-67ff-45ef-8a15-6b962f6f5985 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:23.207323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6365b-67ff-45ef-8a15-6b962f6f5985 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:23.245311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:23.246163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:23.246435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:23.246705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:23.247973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:23.251050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9824164-be0e-4181-8c77-c2d8c2155649 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:23.253172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 563/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:23.262347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:23.375745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67e2bc-6b4d-4d80-a4f9-03e1ba4cd178 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:23.433968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:23.434978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:23.435363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:23.435762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:23.436637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:23.438083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe0e44-2269-47ef-8780-82b9629c1868 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:23.464966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 547/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:25:23 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:25:25.716516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba162d4-bbbf-4b66-bbe7-876b1675d767 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:25.717540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba162d4-bbbf-4b66-bbe7-876b1675d767 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:25.717540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba162d4-bbbf-4b66-bbe7-876b1675d767 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:25.719790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 564/1111] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:25.727897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:25.728336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:25.728429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:25.749454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:25.750642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:25.819028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 548/1112] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:25:25.842603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba162d4-bbbf-4b66-bbe7-876b1675d767 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:25.943243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba162d4-bbbf-4b66-bbe7-876b1675d767 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:25.976294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:25.977070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:25.977343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:25.977611 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] PATH_INFO: `/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:25.979179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] RBAC: Authorizing `identity:get_role(role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:25.980577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:25.981916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 565/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:25 2022] GET /identity/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:25.988124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:26.099107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c11b3-75f5-4681-9862-c97e59509c4e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:26.135036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:26.135993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:26.136278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:26.136554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] PATH_INFO: `/v3/users/c209ed92f1954024996bdaa723222470` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:26.150426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c209ed92f1954024996bdaa723222470)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:26.151926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:26.153599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 549/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:25 2022] GET /identity/v3/users/c209ed92f1954024996bdaa723222470 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:26.160430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:26.256918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd15fb-84e4-4da3-a724-61f5e4865171 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:26.290861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:26.291503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:26.291840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:26.292086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:26.362788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:26.364286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:26.460747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 566/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:26.469385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:26.573711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f08d-20ec-4131-aacc-0935d3c674e4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:26.607235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:26.608641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:26.608932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:26.609204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:26.610417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:26.611898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b116-2959-424f-90f0-a89ec2c5285d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:26.613598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 550/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:26 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:26.620049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:26.720633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9a52-15ad-43bb-a8b6-bf0ab75b81f8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:26.754287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:26.754927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:26.755204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:26.755471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:26.756316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=069d2d9519474d82a5dd07416ee04b75, user.id=c209ed92f1954024996bdaa723222470) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:26.756625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:26.758044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f20a0-0d56-4459-a4e8-e08eee524a41 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:26.763428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 567/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:26 2022] GET /identity/v3/role_assignments?user.id=c209ed92f1954024996bdaa723222470&scope.project.id=069d2d9519474d82a5dd07416ee04b75&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:28.948107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82d5f-b975-4ba3-8381-358aea2b2d6e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:28.949026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82d5f-b975-4ba3-8381-358aea2b2d6e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:28.949026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82d5f-b975-4ba3-8381-358aea2b2d6e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:28.951177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 551/1118] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:28.958072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:28.958509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:28.958642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:28.985437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:28.986607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:29.053862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 568/1119] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:29.086004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82d5f-b975-4ba3-8381-358aea2b2d6e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:29.191505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82d5f-b975-4ba3-8381-358aea2b2d6e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:29.226627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:29.227489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:29.227793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:29.228068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] PATH_INFO: `/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:29.229676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] RBAC: Authorizing `identity:get_role(role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:29.231063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:29.232463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 552/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:29 2022] GET /identity/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:29.238575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:29.340479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb163d9-69a2-4eb5-9519-df5d29b3127f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:29.377956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:29.378835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:29.379094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:29.379367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] PATH_INFO: `/v3/users/c209ed92f1954024996bdaa723222470` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:29.380614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] RBAC: Authorizing `identity:get_user(user_id=c209ed92f1954024996bdaa723222470)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:29.382089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:29.383777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 569/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:29 2022] GET /identity/v3/users/c209ed92f1954024996bdaa723222470 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:29.390379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:29.492724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92135e60-b2c2-4de7-88d3-984d792d88dc None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:29.526617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:29.527472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:29.527775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:29.528038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:29.529329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:29.530848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04331f-9e78-487f-9813-23ad5b14dcd0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:29.532553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 553/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:29 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:29.539041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:29.661948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda64a1a-265d-461c-9162-604990474c1b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:29.698869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:29.699790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:29.700076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:29.700338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75/users/c209ed92f1954024996bdaa723222470/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:29.702956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] RBAC: Authorizing `identity:create_grant(project_id=069d2d9519474d82a5dd07416ee04b75, user_id=c209ed92f1954024996bdaa723222470, role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:29.704438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374580d-62ec-4225-9bf2-d1d9c374e14b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:29.717917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 570/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:25:29 2022] PUT /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75/users/c209ed92f1954024996bdaa723222470/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:25:32.026034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0b2c-e072-4323-ad72-3b8992309c13 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.026884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0b2c-e072-4323-ad72-3b8992309c13 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.026884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0b2c-e072-4323-ad72-3b8992309c13 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.029162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 554/1124] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:32.036216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.036675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.036770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.059131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:32.060342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:32.131166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 571/1125] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:32.155199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0b2c-e072-4323-ad72-3b8992309c13 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:32.263742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0b2c-e072-4323-ad72-3b8992309c13 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:32.298516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:32.299381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.299660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.299958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] PATH_INFO: `/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.301574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] RBAC: Authorizing `identity:get_role(role_id=f3a66dc9ef6e4a23b6fed6c4b5615cf0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:32.302953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:32.304391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 555/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:32 2022] GET /identity/v3/roles/f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:32.311446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:32.434512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf636f8e-8d96-4db7-a16d-e8e7f313f1da None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:32.472702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:32.473577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.473858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.474134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] PATH_INFO: `/v3/users/c209ed92f1954024996bdaa723222470` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.475462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] RBAC: Authorizing `identity:get_user(user_id=c209ed92f1954024996bdaa723222470)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:32.476952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:32.478571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 572/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:32 2022] GET /identity/v3/users/c209ed92f1954024996bdaa723222470 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:32.487754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:32.597239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b17c-1480-46ef-9dba-3535de49ea07 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:32.633080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:32.633733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.634016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.634295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.703074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:32.704495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:32.816260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 556/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:32.822563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:32.939011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c7897-5c7c-4bc8-9ba0-e8036466a45c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:32.975670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:32.976924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:32.977324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:32.977736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] PATH_INFO: `/v3/projects/069d2d9519474d82a5dd07416ee04b75` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:32.979753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] RBAC: Authorizing `identity:get_project(project_id=069d2d9519474d82a5dd07416ee04b75)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:32.982032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6ef0-e3ed-4c4f-ace4-46b2e49dab44 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:32.984995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 573/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:32 2022] GET /identity/v3/projects/069d2d9519474d82a5dd07416ee04b75 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:32.991372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:33.090112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dbceb-caaa-496e-abbc-9095a8f84f58 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:33.124875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:33.125536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:33.125817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:33.126091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:33.126935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] RBAC: Adding query filter params (role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0, scope.project.id=069d2d9519474d82a5dd07416ee04b75, user.id=c209ed92f1954024996bdaa723222470) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:33.127245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:33.128733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d44428-0e97-4b43-9afd-831cbd565e1d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:33.135264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 557/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:32 2022] GET /identity/v3/role_assignments?user.id=c209ed92f1954024996bdaa723222470&scope.project.id=069d2d9519474d82a5dd07416ee04b75&role.id=f3a66dc9ef6e4a23b6fed6c4b5615cf0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:35.375515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3ac2-17f8-4e40-ab00-5144d79c0716 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:35.376272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3ac2-17f8-4e40-ab00-5144d79c0716 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:35.376272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3ac2-17f8-4e40-ab00-5144d79c0716 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:35.377482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 574/1131] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:35.383983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:35.384657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:35.384845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:35.410037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:35.411248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:35.482337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 558/1132] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:35.506047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3ac2-17f8-4e40-ab00-5144d79c0716 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:35.613784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3ac2-17f8-4e40-ab00-5144d79c0716 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:35.648255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:35.648990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:35.649274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:35.649550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:35.650860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:35.652332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8b509-3449-403f-8f30-0c840e3079dc None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:35.653923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 575/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:35.661028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:35.760427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101577-3a48-4b9d-9984-ef190174cb83 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:35.795287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:35.795991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:35.796270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:35.796547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:35.797266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:35.799159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895a2ec-df77-42e3-87dc-95b652fdb69d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:35.830502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 559/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:25:35 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:38.078434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4389-d9a8-406f-889a-f2498891b412 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:38.078973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4389-d9a8-406f-889a-f2498891b412 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:38.078973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4389-d9a8-406f-889a-f2498891b412 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:38.080319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 576/1135] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:38.086805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:38.087564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:38.087730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:38.112611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:38.113802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:38.196845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 560/1136] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:38.222172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb4389-d9a8-406f-889a-f2498891b412 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:38.335153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb4389-d9a8-406f-889a-f2498891b412 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:38.369296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:38.370110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:38.370385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:38.370653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:38.372029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:38.373713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01447127-b748-426f-b896-8c68e5f945d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:38.375342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 577/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:38.381895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:38.514646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef87a-ec16-416a-b55c-c0fe985f9a37 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:38.558555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:38.559645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:38.560123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:38.560595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:38.561661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:38.563531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8031e3-6dc8-4e35-8977-0a2cb0964261 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:38.589386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 561/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:25:38 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:40.907666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94651-dbeb-46a0-82ea-29458517ef21 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:40.908215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94651-dbeb-46a0-82ea-29458517ef21 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:40.908215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94651-dbeb-46a0-82ea-29458517ef21 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:40.909629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 578/1139] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:40.916094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:40.916805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:40.916979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:40.936896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:40.938067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:41.022264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 562/1140] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:41.054744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c94651-dbeb-46a0-82ea-29458517ef21 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:41.158562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c94651-dbeb-46a0-82ea-29458517ef21 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:41.193891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:41.194671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:41.194948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:41.195212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:41.207709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:41.215201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:41.216503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:41.217706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 579/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:41.223180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:41.330048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048c57-b0d9-400d-a3fe-31aa2789d25c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:41.364658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:41.365329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:41.365608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:41.365868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:41.366616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:41.366923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:41.368330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:41.376623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 563/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:41.383203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:41.494730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faa409-62da-4017-96b6-1b272c441c23 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:41.530877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:41.531729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:41.532019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:41.532288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] PATH_INFO: `/v3/users/2457646cefcc474ea7365eb4a85fdd45` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:41.545207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=2457646cefcc474ea7365eb4a85fdd45)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:41.546740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:41.548700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 580/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:41 2022] GET /identity/v3/users/2457646cefcc474ea7365eb4a85fdd45 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:41.557941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:41.660589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c6ed-c1ca-47b2-af45-c1dfda6ae24b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:41.694522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:41.695168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:41.695445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:41.695731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:41.764408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:41.765793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:41.868617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 564/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:41.874831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:41.973713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b29e1d-282f-432e-9716-519ed99a5ea5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:42.006672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:42.007519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:42.007836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:42.008084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] PATH_INFO: `/v3/projects/287bd02a0a15482aae84bcca9e7abec8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:42.009276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] RBAC: Authorizing `identity:get_project(project_id=287bd02a0a15482aae84bcca9e7abec8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:42.010691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7755559-20f4-48b7-8fb0-3b550a791473 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:42.012375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 581/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:41 2022] GET /identity/v3/projects/287bd02a0a15482aae84bcca9e7abec8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:42.022281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:42.126295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e31a32-262d-425e-b26b-3669d70d79cf None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:42.161127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:42.162153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:42.162578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:42.162957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:42.164392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=287bd02a0a15482aae84bcca9e7abec8, user.id=2457646cefcc474ea7365eb4a85fdd45) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:42.164876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:42.167204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def7626-7e82-48ca-9914-e17d2c6c22ea None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:42.176803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 565/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:42 2022] GET /identity/v3/role_assignments?user.id=2457646cefcc474ea7365eb4a85fdd45&scope.project.id=287bd02a0a15482aae84bcca9e7abec8&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:44.354057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8332-bff4-46b2-98b7-d0a7d9da0aba None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.354898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8332-bff4-46b2-98b7-d0a7d9da0aba None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.354898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8332-bff4-46b2-98b7-d0a7d9da0aba None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.357097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 582/1147] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:44.363743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.364412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.364638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.385712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:44.386887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:44.456648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 566/1148] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:44.479486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8332-bff4-46b2-98b7-d0a7d9da0aba None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:44.592445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8332-bff4-46b2-98b7-d0a7d9da0aba None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:44.627154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:44.627909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.628187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.628456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.638374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:44.646090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:44.647177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:44.648543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 583/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:44.659629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:44.762475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc1cc2-501f-4fa7-9a0b-ebce33ba1978 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:44.797898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:44.798576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.798858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.799134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.799913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:44.800216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:44.801620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:44.809642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 567/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:44.815887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:44.920092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69b30-121c-47b1-b728-645b308712a8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:44.953686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:44.954560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.954840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.955111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] PATH_INFO: `/v3/users/2457646cefcc474ea7365eb4a85fdd45` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.956333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=2457646cefcc474ea7365eb4a85fdd45)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:44.957762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:44.959401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 584/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:44 2022] GET /identity/v3/users/2457646cefcc474ea7365eb4a85fdd45 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:44.968712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:45.080591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524d73-1d46-47f7-83b6-2f1753798299 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:45.114743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:45.115600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:45.115914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:45.116187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] PATH_INFO: `/v3/projects/287bd02a0a15482aae84bcca9e7abec8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:45.117491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] RBAC: Authorizing `identity:get_project(project_id=287bd02a0a15482aae84bcca9e7abec8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:45.118938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57114f78-b61c-4ce0-8622-3decf9db67d3 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:45.120648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 568/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:44 2022] GET /identity/v3/projects/287bd02a0a15482aae84bcca9e7abec8 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:45.130698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:45.245766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8073c-0102-453d-8c82-5b735554f2e8 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:45.280806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:45.281695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:45.282004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:45.282274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] PATH_INFO: `/v3/projects/287bd02a0a15482aae84bcca9e7abec8/users/2457646cefcc474ea7365eb4a85fdd45/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:45.284691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] RBAC: Authorizing `identity:create_grant(project_id=287bd02a0a15482aae84bcca9e7abec8, user_id=2457646cefcc474ea7365eb4a85fdd45, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:45.286162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666177-1d70-48c9-8328-662314d4b4fb None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:45.303185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 585/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:25:45 2022] PUT /identity/v3/projects/287bd02a0a15482aae84bcca9e7abec8/users/2457646cefcc474ea7365eb4a85fdd45/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:25:47.511411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60ffd-da86-4224-ba76-f7be04212e9e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.512315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60ffd-da86-4224-ba76-f7be04212e9e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.512315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60ffd-da86-4224-ba76-f7be04212e9e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.514420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 569/1154] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:47.523243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.523986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.524230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.544701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:47.546256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:47.613538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 586/1155] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:47.647439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c60ffd-da86-4224-ba76-f7be04212e9e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:47.752776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c60ffd-da86-4224-ba76-f7be04212e9e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:47.787419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:47.788197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.788475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.788745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.802168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:25:47.809712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:47.810821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:25:47.811991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 570/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:47.817027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:47.923028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722878f-8d25-4ad0-bbdb-540ef00dfac8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:47.958486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:47.959276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.959588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.959892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.960827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:47.961248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:47.962644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:47.972028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 587/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:47.980025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:48.086479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b1eb-6adc-412e-9490-5b5e94725ac3 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:48.122188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:48.123177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:48.123679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:48.123995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] PATH_INFO: `/v3/users/2457646cefcc474ea7365eb4a85fdd45` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:48.125322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] RBAC: Authorizing `identity:get_user(user_id=2457646cefcc474ea7365eb4a85fdd45)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:48.126757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:48.128410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 571/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:25:47 2022] GET /identity/v3/users/2457646cefcc474ea7365eb4a85fdd45 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:48.135050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:48.243640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2100e-fd43-4204-b3d4-4edb8719a71b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:48.278093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:48.278745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:48.279032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:48.279378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:48.345966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:48.347349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:48.443965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 588/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:48.452953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:48.553800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b0ce-7643-464f-8adc-86bbfc9acc58 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:48.591339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:48.592375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:48.592657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:48.592927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] PATH_INFO: `/v3/projects/287bd02a0a15482aae84bcca9e7abec8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:48.594243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] RBAC: Authorizing `identity:get_project(project_id=287bd02a0a15482aae84bcca9e7abec8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:48.595709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37c19-2be8-4498-8283-a137992793f9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:48.597504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 572/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:25:48 2022] GET /identity/v3/projects/287bd02a0a15482aae84bcca9e7abec8 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:48.603631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:48.702011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c28a5-f10e-4c00-80a8-21a110cb7624 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:48.736401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:48.737050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:48.737339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:48.737609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:48.738429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=287bd02a0a15482aae84bcca9e7abec8, user.id=2457646cefcc474ea7365eb4a85fdd45) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:48.738742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:48.740204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83ebf-0534-4e11-8cb7-13945106565b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:48.745982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 589/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:25:48 2022] GET /identity/v3/role_assignments?user.id=2457646cefcc474ea7365eb4a85fdd45&scope.project.id=287bd02a0a15482aae84bcca9e7abec8&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:25:51.014666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec418-acab-4612-ac91-f2483275a023 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:51.015261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec418-acab-4612-ac91-f2483275a023 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:51.015261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec418-acab-4612-ac91-f2483275a023 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:51.016641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 573/1162] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:51.023077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:51.023804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:51.024050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:51.044419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:51.045597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:51.112933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 590/1163] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:51.135344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ec418-acab-4612-ac91-f2483275a023 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:51.247224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ec418-acab-4612-ac91-f2483275a023 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:51.284079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:51.285095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:51.285538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:51.285958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:51.363553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:51.364997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:51.461631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 574/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:25:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:25:51.472063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:51.578078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e69026-d4c2-4e1e-a191-be7f44915f6a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:51.613132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:51.613992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:51.614210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:51.614474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:51.621379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:51.622856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d9fe7685-3ecf-4029-afc7-a2e52dde7666 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:25:51.637494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:25:51.643648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:25:51.644770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 591/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:25:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:25:51.646905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:51.754285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71785df-d4a9-4930-a12a-af0be1b50fa8 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:51.789310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:51.789967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:51.790247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:51.790517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:51.791234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:25:51.791537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:51.793007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47665f-b62e-4ee6-81db-021da7f61da7 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:51.800775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 575/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Thu May 12 14:25:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:54.015005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30cf1-31d4-4f42-81de-56859c714bfc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.015957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30cf1-31d4-4f42-81de-56859c714bfc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.015957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30cf1-31d4-4f42-81de-56859c714bfc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.018159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 592/1167] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:54.024579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a86d-a389-4dc6-b428-38e713487054 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.025348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a86d-a389-4dc6-b428-38e713487054 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.025519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a86d-a389-4dc6-b428-38e713487054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.044425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-29f8a86d-a389-4dc6-b428-38e713487054 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:54.045628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-29f8a86d-a389-4dc6-b428-38e713487054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:54.126359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 576/1168] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:54.149171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30cf1-31d4-4f42-81de-56859c714bfc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:54.267453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30cf1-31d4-4f42-81de-56859c714bfc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:54.304273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:54.304943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.305221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.305497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.306247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:54.307616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff56980-bc24-4f43-82ee-bdfde19d2be7 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:54.328989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 593/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Thu May 12 14:25:54 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:56.546617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2c6d-7f60-48c0-9994-efa9905c6386 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:56.547207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2c6d-7f60-48c0-9994-efa9905c6386 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:56.547207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2c6d-7f60-48c0-9994-efa9905c6386 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:56.548901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 577/1170] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:56.555336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:56.556147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:56.556301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:56.576411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:56.577617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:56.644252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 594/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:56.678624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2c6d-7f60-48c0-9994-efa9905c6386 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:56.791813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2c6d-7f60-48c0-9994-efa9905c6386 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:56.828109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:56.828988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:56.829271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:56.829541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] PATH_INFO: `/v3/domains/5863674b2a5349658e3ab6c4e0321d70` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:56.840501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5863674b2a5349658e3ab6c4e0321d70)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:56.842170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554cb32-62fb-465e-ab0f-8e0a086e0a86 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:56.843857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 578/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Thu May 12 14:25:56 2022] GET /identity/v3/domains/5863674b2a5349658e3ab6c4e0321d70 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:56.849946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:56.953446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386df7e-5de0-44fa-b7c9-8b7956d8ca3b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:56.988087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:56.988737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:56.989011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:56.989284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:56.989990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:56.991421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738df52-0a4a-4f18-9735-74af3da10b08 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:57.019563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 595/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:25:56 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:25:59.245751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04347d7-b2e0-4797-8fb6-66803a6f54c7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:59.246651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04347d7-b2e0-4797-8fb6-66803a6f54c7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:59.246651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04347d7-b2e0-4797-8fb6-66803a6f54c7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:59.248621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 579/1174] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:59.255110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:59.255845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:59.255970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:59.282281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:59.283476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:59.363702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 596/1175] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:25:59.389511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04347d7-b2e0-4797-8fb6-66803a6f54c7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:59.513447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04347d7-b2e0-4797-8fb6-66803a6f54c7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:59.546945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:59.548165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:59.548442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:59.548698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] PATH_INFO: `/v3/domains/5863674b2a5349658e3ab6c4e0321d70` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:59.549958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=5863674b2a5349658e3ab6c4e0321d70)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:59.551392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a924-9ae0-4d03-ac79-49f2f31249cc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:59.553037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 580/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Thu May 12 14:25:59 2022] GET /identity/v3/domains/5863674b2a5349658e3ab6c4e0321d70 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:25:59.558864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:59.656304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4abd-69b6-400d-8704-5bc966feba02 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:59.693730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:59.694395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:59.694668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:59.694937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:59.695650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:59.697115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52158-9d6d-4fb0-8eb5-2fedd21b077d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:59.724292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 597/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:25:59 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:26:01.956820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2d6d-b7dd-4ef5-b024-c97a9e772557 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:01.957760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2d6d-b7dd-4ef5-b024-c97a9e772557 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:01.957760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2d6d-b7dd-4ef5-b024-c97a9e772557 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:01.960091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 581/1178] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:26:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:26:01.965629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:01.966064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:01.966163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:01.985289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:26:01.986459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:26:02.061227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 598/1179] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:26:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:26:02.084826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa2d6d-b7dd-4ef5-b024-c97a9e772557 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:02.207948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa2d6d-b7dd-4ef5-b024-c97a9e772557 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:02.246011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:02.246809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:02.247090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:02.247366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:02.258721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:26:02.266689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:26:02.267825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:26:02.268848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 582/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:26:02.277386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:02.379653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809064b-b8cd-454d-aef3-24ec750d1458 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:02.415445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:02.416149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:02.416433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:02.416717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:02.417461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:26:02.417766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:02.419142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:02.428111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 599/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:02.434225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:02.546897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d88e0-97cd-45ee-802a-cd6c0cde3d88 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:02.581982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:02.582875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:02.583153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:02.583423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] PATH_INFO: `/v3/users/f223271f10b94e608588a91dd87107d4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:02.597566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] RBAC: Authorizing `identity:get_user(user_id=f223271f10b94e608588a91dd87107d4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:02.599050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:02.600716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 583/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:26:02 2022] GET /identity/v3/users/f223271f10b94e608588a91dd87107d4 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:02.606767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:02.707870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a983-7202-4bd6-8784-c77e39bd8c8d None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:02.741305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:02.741949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:02.742225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:02.742496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:02.808651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:02.810092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:02.907444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 600/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:26:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:26:02.913742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:03.034104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bce0a-8f3f-41f4-96d2-b7775b3d525d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:03.068395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:03.069257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:03.069530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:03.069794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] PATH_INFO: `/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:03.071079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d9218fd06c46b1bb6b74b31fe26570)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:03.072546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa271e7-1f56-44d5-be4c-059d7ec29648 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:03.074192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 584/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:26:02 2022] GET /identity/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:03.080805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:03.180120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5e067-27ba-4a4d-a530-f33334b415b4 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:03.214332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:03.214974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:03.215245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:03.215497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:03.216351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=d1d9218fd06c46b1bb6b74b31fe26570, user.id=f223271f10b94e608588a91dd87107d4) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:26:03.216657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:03.218215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece26b7-c68e-43af-90f3-a52a89ce653d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:03.223448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 601/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:26:03 2022] GET /identity/v3/role_assignments?user.id=f223271f10b94e608588a91dd87107d4&scope.project.id=d1d9218fd06c46b1bb6b74b31fe26570&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:05.448978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61155-cc1b-4c5f-bc0e-dcc23a823d20 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:05.450002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61155-cc1b-4c5f-bc0e-dcc23a823d20 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:05.450002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61155-cc1b-4c5f-bc0e-dcc23a823d20 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:05.452109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 585/1186] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:26:05.458663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:05.459354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:05.459535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:05.478337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:26:05.479496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:26:05.545560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 602/1187] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:26:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:26:05.568766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61155-cc1b-4c5f-bc0e-dcc23a823d20 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:05.676975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61155-cc1b-4c5f-bc0e-dcc23a823d20 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:05.711936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:05.712664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:05.713022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:05.713296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:05.724275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:26:05.731923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:26:05.733116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:26:05.734235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 586/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:26:05.739608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:05.850543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27571c-bf92-4f00-9f40-6d4dfe180706 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:05.891145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:05.891855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:05.892138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:05.892417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:05.893174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:26:05.893479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:05.894894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:05.902909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 603/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:05.909882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:06.024519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac49-823b-472a-bdd6-fc050e77c3a6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:06.060938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:06.061811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:06.062090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:06.062370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] PATH_INFO: `/v3/users/f223271f10b94e608588a91dd87107d4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:06.063716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] RBAC: Authorizing `identity:get_user(user_id=f223271f10b94e608588a91dd87107d4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:06.065155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:06.066781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 587/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:26:05 2022] GET /identity/v3/users/f223271f10b94e608588a91dd87107d4 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:06.076020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:06.188568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59fea-ceee-4171-8499-ae14f9f61a5c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:06.225165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:06.226033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:06.226312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:06.226588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] PATH_INFO: `/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:06.227924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] RBAC: Authorizing `identity:get_project(project_id=d1d9218fd06c46b1bb6b74b31fe26570)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:06.229355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d7be2-0a5d-4e1f-a336-73eb6829f44f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:06.231110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 604/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:26:06 2022] GET /identity/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:06.237625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:06.351874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66859b2-2135-44b4-b933-2f82e74a356c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:06.385066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:06.385969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:06.386245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:06.386514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] PATH_INFO: `/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570/users/f223271f10b94e608588a91dd87107d4/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:06.388534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d9218fd06c46b1bb6b74b31fe26570, user_id=f223271f10b94e608588a91dd87107d4, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:06.390160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2399f-c1ed-409d-9b5c-8b3e607c9b7f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:06.406144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 588/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:26:06 2022] PUT /identity/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570/users/f223271f10b94e608588a91dd87107d4/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:26:08.626613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920f32-6ab3-48bf-9b57-1caeae57e0d5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:08.627521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920f32-6ab3-48bf-9b57-1caeae57e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:08.627521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d920f32-6ab3-48bf-9b57-1caeae57e0d5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:08.629734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 605/1193] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:26:08.636197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:08.636915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:08.637101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:08.656765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:26:08.657960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:26:08.727466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 589/1194] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:26:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:26:08.754391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d920f32-6ab3-48bf-9b57-1caeae57e0d5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:08.872705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d920f32-6ab3-48bf-9b57-1caeae57e0d5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:08.906917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:08.907656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:08.907968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:08.908226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:08.918128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:26:08.926485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:26:08.927558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:26:08.928545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 606/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:26:08.935661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:09.048747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7062a9-7fd9-49db-8fef-3209da1e7f2f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:09.082903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:09.083578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:09.083885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:09.084157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:09.084909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:26:09.085220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:09.086599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:09.094735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 590/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:26:09.103607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:09.204332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca00c2-5664-4832-8743-5cecae6e1e08 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:09.238955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:09.239862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:09.240134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:09.240404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] PATH_INFO: `/v3/users/f223271f10b94e608588a91dd87107d4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:09.241730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] RBAC: Authorizing `identity:get_user(user_id=f223271f10b94e608588a91dd87107d4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:09.243227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:09.244875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 607/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Thu May 12 14:26:09 2022] GET /identity/v3/users/f223271f10b94e608588a91dd87107d4 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:09.253032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:09.357007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa60ab-36cc-4830-9c15-d43ad216c00c None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:09.391410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:09.392075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:09.392357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:09.392632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:09.460317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:09.461713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:09.560604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 591/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:26:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:26:09.573962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:09.685092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a2566-109b-47d1-aabd-af3c82b8402f None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:09.719053 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:09.719887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:09.720176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:09.720445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] PATH_INFO: `/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:09.721737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d9218fd06c46b1bb6b74b31fe26570)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:09.723188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c232c9-0134-4e31-a240-152a2622de39 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:09.724963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 608/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Thu May 12 14:26:09 2022] GET /identity/v3/projects/d1d9218fd06c46b1bb6b74b31fe26570 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:26:09.731381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:26:09.832308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864d8d0-5718-4783-93b0-71e624604cca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:26:09.868288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:26:09.868957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:26:09.869241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:26:09.869514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:26:09.870353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=d1d9218fd06c46b1bb6b74b31fe26570, user.id=f223271f10b94e608588a91dd87107d4) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:26:09.870666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:26:09.872233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54864980-3cb9-4e5d-835a-af69ee9e2aa6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:26:09.878469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 592/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:26:09 2022] GET /identity/v3/role_assignments?user.id=f223271f10b94e608588a91dd87107d4&scope.project.id=d1d9218fd06c46b1bb6b74b31fe26570&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:11.113761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fa51-5605-4ad6-a614-a5b4354ccc1d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:11.114374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fa51-5605-4ad6-a614-a5b4354ccc1d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:11.114374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fa51-5605-4ad6-a614-a5b4354ccc1d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:11.115891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 609/1201] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:11.122129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:11.122797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:11.122797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:11.140330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:11.141689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:11.222095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 593/1202] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:11.249387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003fa51-5605-4ad6-a614-a5b4354ccc1d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:11.397367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003fa51-5605-4ad6-a614-a5b4354ccc1d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:11.435017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:11.438437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:11.438437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:11.438437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:11.453781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:11.455442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:11.478822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:11.480112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:11.481112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:11.481112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:11.481112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:11.481112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:11.483882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 610/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:11.488467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:11.620160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5bcaf-fbcb-4d36-8392-fe44e98fc4a0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:11.667011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:11.668110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:11.668569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:11.668848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:11.669760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:11.670116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:11.671944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17c31e-3f28-4f0f-8d87-346f649e20bc None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:11.691243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 594/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:11.693298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:11.819144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea610a9-ecac-4cbc-8799-71c8f84bdfe6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:11.868561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:11.869319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:11.869595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:11.869874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:11.870739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:11.872561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9119-cbe0-4522-b2c7-16d7704e6f71 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:11.911718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 611/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Thu May 12 14:27:11 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:27:14.548431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6bd5-c5fd-44b5-a030-04b522b75b50 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:14.549048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6bd5-c5fd-44b5-a030-04b522b75b50 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:14.549048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d6bd5-c5fd-44b5-a030-04b522b75b50 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:14.550588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 595/1206] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:27:14.556622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:14.557142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:14.557246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:14.575185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:14.576443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:14.646865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 612/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:27:14.670123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6bd5-c5fd-44b5-a030-04b522b75b50 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:14.792811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d6bd5-c5fd-44b5-a030-04b522b75b50 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:14.832784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:14.833691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:14.833984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:14.834275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:14.846434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:14.854837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:14.855963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:14.856981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 596/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:14.862650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:14.987382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca097db-8401-4745-8278-46aa49a4ca34 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.024061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.024791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.025076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.025405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:15.026281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:15.026586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:15.028298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:15.037737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 613/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:15.043712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:15.172416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5ee7f-30bd-4ec3-b9e9-2e1959caf141 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.216055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.217036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.217336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.217679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:15.228965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:15.230630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:15.249393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:15.251371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:15.253179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:15.253179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:15.253179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:15.253179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:15.253179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 597/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:15.259605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:15.369195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb59c-8350-42e1-bfd3-53fc27c62d5e None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.409114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.410236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.410467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.410759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:15.411586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:15.411955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:15.413501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:15.428151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 614/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:15.435601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:15.543158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee68a-d3db-4eea-921c-06c386377eca None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.581626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.582464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.582739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.583019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:15.591265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:15.592799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:15.607714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:15.608820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:15.609821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 598/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:15.617907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:15.728529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916514c3-3ea3-49d1-b827-4d0832c67678 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.767362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.768114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.768403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.768616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:15.769461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:15.769782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:15.771213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:15.789843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 615/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:15.796212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:15.909978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d89e-5249-4c68-8e5f-e0b09036fd25 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:15.947885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:15.949552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:15.949552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:15.949552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:16.031861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:16.032046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:16.142129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 599/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:27:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:27:16.148259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:16.267255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951f1c-6a25-4598-bbbb-afb9da86d97c None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:16.309908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:16.310720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:16.311118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:16.311365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:16.324221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:16.326025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:16.345448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:16.346830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:16.352878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:16.352878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:16.352878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:16.352878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:16.352878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 616/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:16.353421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:16.469970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9f16-8636-4973-9a82-ea17c0465c12 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:16.506893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:16.508077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:16.508567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:16.509117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:16.510304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:16.510883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:16.513022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:16.527112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 600/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:16.532614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:16.650108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4f91-595d-4800-b056-04c7e0e71b55 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:16.691026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:16.691868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:16.692146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:16.692420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:16.699378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:16.700940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:16.714558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:16.715827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:16.716910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 617/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:16.721741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:16.828957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba2c5-ad71-4c06-b3b5-fd07c85dbf3e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:16.864863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:16.866758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:16.867053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:16.867309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:16.868301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:16.868700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:16.870155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36efe-6c68-4048-b1e8-0f51c49d11d5 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:16.883304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 601/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:16.889219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:16.998851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200983c-2f49-4fb8-bb69-f448a98f36ad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:17.036265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:17.036935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:17.037227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:17.037501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:17.038353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=053ed1bdb47c44fc8c581c1485fde6c3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:17.038691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:17.040155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b2d1-328b-42b7-9147-d0e471170ab1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:17.046310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 618/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:27:16 2022] GET /identity/v3/role_assignments?user.id=053ed1bdb47c44fc8c581c1485fde6c3&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:19.415360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17a82-479d-4cfa-824a-72bc3e9a927a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:19.415948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17a82-479d-4cfa-824a-72bc3e9a927a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:19.415948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17a82-479d-4cfa-824a-72bc3e9a927a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:19.417737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 602/1220] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:19.424261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:19.424708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:19.424818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:19.442610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:19.443833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:19.515849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 619/1221] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:19.538229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17a82-479d-4cfa-824a-72bc3e9a927a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:19.647311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17a82-479d-4cfa-824a-72bc3e9a927a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:19.681890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:19.682627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:19.682907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:19.683179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:19.693067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:19.700868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:19.702066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:19.703487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 603/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:19.708261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:19.823343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba828147-2348-43be-b046-5c8ba9b470fc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:19.858386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:19.859077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:19.859356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:19.859630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:19.860427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] RBAC: Adding query filter params (name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:19.860733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:19.862153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:19.870451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 620/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:27:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:19.876744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:19.988407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb001-5cbc-4369-b40e-19ccd78ae4df None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.029202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.030150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.030445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.030739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.042631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.044272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:20.062527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:20.063762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:20.064852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:20.064852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:20.064852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:20.064852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:20.064852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 604/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:27:20.071403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:20.178433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e6da-a4f2-4fe6-bf1f-0817352c0171 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.213570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.214259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.214521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.214795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.215572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:20.215894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.217416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.229916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 621/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:20.235996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:20.340055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e835d-2532-4fb6-a893-cb3331460bfb None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.380337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.381537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.381837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.382098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.392532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.394398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:20.409886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:20.410972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:20.412018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 605/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:20.417436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:20.518997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb79b-97eb-430d-af03-d55ebcdc29f0 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.555357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.556199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.556614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.556931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.558005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:20.558417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.560572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.582018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 622/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:20.587820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:20.694492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4aa6-592c-4680-b0d1-fd324f456e7f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.729895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.730731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.731008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.731405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.742299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.743804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:20.760723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:20.761858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:20.763283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:20.763283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:20.763283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:20.763283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:20.763283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 606/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:20.767829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:20.870894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cb13-f38b-46c3-af71-524bf6df4a13 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:20.906085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:20.906763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:20.907025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:20.907300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:20.908088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:20.908351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:20.909748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:20.921391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 623/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:20.927734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:21.045395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a2cc-8376-4c2a-822f-b650d796d28d None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:21.083145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:21.084014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:21.084360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:21.084641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:21.092063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:21.093667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:21.109327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:21.110488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:21.111382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 607/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:21.116734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:21.225502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618dcd-4293-4778-95e3-060d55a72205 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:21.262131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:21.262979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:21.263280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:21.263619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:21.264446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:21.264752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:21.266207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bcc4b-d287-4a31-bbd2-cb27701d94a5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:21.279349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 624/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:21.285875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:21.398895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44976c0-0fec-4d9b-a16b-da199fc054ab None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:21.438121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:21.439084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:21.439397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:21.439668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/053ed1bdb47c44fc8c581c1485fde6c3/roles/06db67ffd8e14fee810fa3b0a76d4ace` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:21.455289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=053ed1bdb47c44fc8c581c1485fde6c3, role_id=06db67ffd8e14fee810fa3b0a76d4ace)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:21.457367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba17a7-552f-4510-9ff4-dfdc2bb8f34f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:21.471874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 608/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:27:21 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/053ed1bdb47c44fc8c581c1485fde6c3/roles/06db67ffd8e14fee810fa3b0a76d4ace => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:27:23.673162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749001-fda3-4b88-8c22-15f4164a3ba9 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.673770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749001-fda3-4b88-8c22-15f4164a3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.673770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749001-fda3-4b88-8c22-15f4164a3ba9 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.675065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 625/1233] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:23.680395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.680918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.680918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.697431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:23.698589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.765267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 609/1234] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:23.787847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749001-fda3-4b88-8c22-15f4164a3ba9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:23.894684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749001-fda3-4b88-8c22-15f4164a3ba9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:23.929843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:23.930581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.930898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.931161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.942943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:23.952134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:23.958328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:23.959251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 626/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Thu May 12 14:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:23.959997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.074574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f067d-7f93-491d-b215-5d6180bf7e42 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.110816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.111488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.111787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.112059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:24.112805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:24.113105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:24.114479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.123296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 610/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Thu May 12 14:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:24.129159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.234728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ecf4f-059c-4937-82c7-80b366e85845 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.268277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.269091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.269372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.269644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:24.281387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:24.282841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:24.301748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:24.303091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:24.304364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:24.304364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:24.304364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:24.304364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:24.304364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 627/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:24.309047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.414526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871cd5-a21c-4aa4-a0ef-05a183696a3f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.451362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.452138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.452420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.452694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:24.453495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:24.453868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:24.455383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.467529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 611/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:24.473209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.576879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b759c1-8e08-4d32-8d97-d2c451f55b53 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.609715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.610529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.610808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.611080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:24.619399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:24.620930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:24.636366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:24.637783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:24.638992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 628/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:24.644193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.746502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802c8a-f962-4727-85bb-4ee932a291be None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.781492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.782174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.782505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.782813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:24.783822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:24.784190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:24.785876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.803993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 612/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:24.809873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:24.938127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d2e91-4b5d-4789-8001-3b364d4edfc9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:24.990035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:24.990882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:24.991199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:24.991586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:25.074891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:25.076750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:25.200740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 629/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:27:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:27:25.206959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:25.315717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6925-e4cd-4dd1-b223-9232186e95d2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:25.352586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:25.353440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:25.353716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:25.354022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:25.365087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:25.366646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:25.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:25.386716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:25.388250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:25.388250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:25.388250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:25.388250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:25.388250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 613/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:25.393647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:25.496782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf85be3-b0f0-4ea0-8a1a-4c1c1747927a None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:25.536425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:25.537127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:25.537413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:25.537747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:25.538477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:25.538786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:25.540308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:25.553090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 630/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:25.558856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:25.666512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a08504-a741-4dc8-a194-d4f61d55fcc2 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:25.706183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:25.707311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:25.707584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:25.707885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:25.716174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:25.718745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:25.737069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:25.738404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:25.739337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 614/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:27:25.744569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:25.855468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bccb-6b8a-4bdf-aa82-3214f3bdc7d9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:25.890691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:25.891378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:25.891722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:25.891994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:25.892826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:25.893139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:25.894704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d834-a6be-48ba-9d16-6518433a6996 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:25.907364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 631/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:25.914046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:26.020757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b33b7-85ad-4dd6-bcb4-1998f89e9093 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:26.056631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:26.057300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:26.057601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:26.057853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:26.058738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] RBAC: Adding query filter params (role.id=06db67ffd8e14fee810fa3b0a76d4ace, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=053ed1bdb47c44fc8c581c1485fde6c3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:26.059071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:26.060639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1588c3-bfda-47bf-9de9-9354c9a55e31 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:26.066815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 615/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:27:25 2022] GET /identity/v3/role_assignments?user.id=053ed1bdb47c44fc8c581c1485fde6c3&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=06db67ffd8e14fee810fa3b0a76d4ace => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:28.371383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabcc-5ecf-4688-a645-296998ef6d79 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:28.372032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabcc-5ecf-4688-a645-296998ef6d79 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:28.372032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfabcc-5ecf-4688-a645-296998ef6d79 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:28.373454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 632/1247] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:28.378914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:28.379327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:28.379471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:28.398323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:28.399622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:28.472752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 616/1248] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:28.499858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfabcc-5ecf-4688-a645-296998ef6d79 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:28.609266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfabcc-5ecf-4688-a645-296998ef6d79 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:28.645057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:28.645836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:28.646117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:28.646388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:28.660693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:28.670521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:28.671868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:28.672801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:28.673692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 633/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:28.680535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:28.792214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a3e42-d7c4-4f8e-9cc9-7c4ca2f08da2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:28.831043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:28.831887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:28.832309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:28.832603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:28.833601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:28.833988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:28.835783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:28.846280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 617/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:28.852536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:28.961880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7c469-4a41-4746-a528-b5ff3be491c9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:29.001157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:29.001978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:29.002253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:29.002526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:29.015171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:29.016692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:29.036923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:29.038086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:29.039130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:29.039130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:29.039130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:29.039130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:29.039130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 634/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:29.044501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:29.154072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94b26-7e13-4f9e-8502-594bbb0775c4 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:29.191650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:29.192364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:29.192703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:29.192997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:29.194886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:29.195200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:29.196622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:29.210405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 618/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:29.216749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:29.326190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c162b-8e90-4cdb-88ce-de18d2a498f9 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:29.363054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:29.363895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:29.364182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:29.364516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:29.372527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:29.374017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:29.390057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:29.391278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:29.397287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 635/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:27:29.397939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:29.521169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe623-346c-49e1-8ea5-e62b724aaf9b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:29.564267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:29.564938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:29.565221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:29.565501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:29.566353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:29.566663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:29.568454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:29.600545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 619/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:29.608986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:29.733958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa71a5-b13b-4006-b123-a6a9e0a58acd None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:29.770910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:29.771673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:29.771993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:29.772264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:29.842493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:29.844176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:29.945962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 636/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:27:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:27:29.951955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:30.081076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c642c-1c63-4193-b366-6a9fab677114 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:30.119190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:30.120173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:30.120461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:30.120732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:30.131529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:30.133330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:30.152212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:30.153895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:30.154814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:30.154814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:30.154814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:30.154814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:30.154814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 620/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:27:30.160050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:30.268411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2f3b-745c-444e-8473-f669ebd49151 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:30.308982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:30.310218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:30.310502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:30.310777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:30.311504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:30.311921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:30.313321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:30.326605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 637/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:30.332868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:30.438176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484fee-8039-4a3c-8fa4-aae40d24dd6e None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:30.474576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:30.475423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:30.475721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:30.476008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:30.483704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:30.485296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:30.499812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:30.500844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:30.501762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 621/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:30.506933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:30.616389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31556-add9-4b12-9ae1-9ea0c39336e6 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:30.652322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:30.653656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:30.653962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:30.654243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:30.655141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:30.655468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:30.657074 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6a6dd-d6b0-4a8b-ba15-66e30f9fed47 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:30.671089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 638/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:30.677787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:30.788515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd476-20d6-4e1c-8d16-6f433f375ad6 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:30.825548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:30.826240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:30.826524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:30.826808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:30.827745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=053ed1bdb47c44fc8c581c1485fde6c3) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:30.828117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:30.829634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8aa2-220d-42f9-975f-509f0161880b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:30.846979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 622/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:27:30 2022] GET /identity/v3/role_assignments?user.id=053ed1bdb47c44fc8c581c1485fde6c3&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:33.053613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1d86-2dd5-49e2-85f0-3c2fde3d960f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.054497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1d86-2dd5-49e2-85f0-3c2fde3d960f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.054497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1d86-2dd5-49e2-85f0-3c2fde3d960f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.056702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 639/1261] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:33.063531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.064287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.064436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.087501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:33.088726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:33.161562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 623/1262] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:33.187419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1d86-2dd5-49e2-85f0-3c2fde3d960f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:33.293182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1d86-2dd5-49e2-85f0-3c2fde3d960f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:33.328298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:33.329088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.329370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.329644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.340397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:33.348100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:33.349163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:33.350170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:33.351851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 640/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:33.355277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:33.458243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e3df8-1192-4711-ac3e-5e0335ed1ef8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:33.492069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:33.492728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.493004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.493276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.494019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:33.494322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:33.495730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:33.503754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 624/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:33.509712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:33.609966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397ea16-7903-477c-bc30-6cb5abae2ca2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:33.642875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:33.643654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.643964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.644237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.654775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:33.656265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:33.673624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:33.674677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:33.676222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:33.676222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:33.676222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:33.676222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:33.676222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 641/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:33.683222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:33.786652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbced81-4fff-4330-9373-b92f0c6a2324 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:33.820722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:33.821387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.821661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.821930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.822648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:33.822944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:33.824344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:33.836181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 625/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:33.842003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:33.945269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23e64-774e-4330-94a7-0ce362cd10f2 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:33.983966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:33.984923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:33.985176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:33.985459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:33.994439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:33.996090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:34.011282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:34.012728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:34.014513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 642/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:34.019005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:34.136436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2958f-6ee4-4c00-ae26-a9b525d1d792 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:34.173038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:34.173714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:34.173994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:34.174268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:34.175105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:34.175375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:34.176894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.194335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 626/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:34.203141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:34.315853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bd47-ebca-475f-8212-ffdb377dda54 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:34.352741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:34.353530 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:34.353809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:34.354082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:34.365957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:34.367418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:34.384444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:34.385523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:34.386599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:34.386599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:34.386599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:34.386599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:34.386599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 643/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:34.392082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:34.493971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb2c5-77c9-45d2-b928-5241d9d9e6f0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:34.528580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:34.529239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:34.529524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:34.529795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:34.530515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:34.530821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:34.532230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.543545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 627/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:34.552467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:34.655453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8df5c7-9f01-46ad-863d-8fdbb33104d3 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:34.689379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:34.690163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:34.690448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:34.690717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:34.697609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:34.699036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:34.713581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:34.714625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:34.716521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 644/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:34.724076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:34.827820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cce59-f86f-49c2-bea5-e83aaa4a863b None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:34.868158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:34.868826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:34.869112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:34.869384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:34.870175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:34.870482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:34.872258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fd9f-6532-44cd-acdc-c66aba457599 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:34.884890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 628/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:34.891136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:35.003701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d6a-fde3-47b9-95d0-c35135414b39 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:35.037428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:35.038326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:35.038606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:35.038881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] PATH_INFO: `/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/053ed1bdb47c44fc8c581c1485fde6c3/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:35.040845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] RBAC: Authorizing `identity:create_grant(project_id=548da44dc2034c3eb7cb3df5fc2c3dcf, user_id=053ed1bdb47c44fc8c581c1485fde6c3, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:35.042282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191873-5201-4d60-b15a-4dc60e74767d None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:35.056992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 645/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Thu May 12 14:27:34 2022] PUT /identity/v3/projects/548da44dc2034c3eb7cb3df5fc2c3dcf/users/053ed1bdb47c44fc8c581c1485fde6c3/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:27:37.288832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87cb-2012-4034-9f31-ff91b8566bf2 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:37.289684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87cb-2012-4034-9f31-ff91b8566bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:37.289684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c87cb-2012-4034-9f31-ff91b8566bf2 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:37.291813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 629/1274] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:37.298289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:37.298711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:37.298800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:37.317366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:37.318550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:37.388088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 646/1275] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:37.413129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c87cb-2012-4034-9f31-ff91b8566bf2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:37.527012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c87cb-2012-4034-9f31-ff91b8566bf2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:37.563399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:37.564148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:37.564426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:37.564693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:37.575420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:27:37.582953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:37.584012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:37.584973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 630/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Thu May 12 14:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:37.592878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:37.694037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0e2d0-7f39-469d-b52a-ae73078c9785 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:37.728071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:37.728730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:37.729007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:37.729283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:37.730028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:37.730305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:37.731745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:37.739727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 647/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Thu May 12 14:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:37.745630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:37.861958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06589dc4-2428-43e6-8de1-cb7e0b091705 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:37.904720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:37.905558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:37.905837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:37.906105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:37.917100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:37.918750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:37.936431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:37.937431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:37.938466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:37.938466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:37.938466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:37.938466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:37.938466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 631/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:37.946525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:38.061141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2841d-244f-41c4-bf99-1520a4d14be1 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:38.098241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:38.098906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:38.099182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:38.099458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:38.100219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:38.100524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:38.101887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:38.114130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 648/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:38.122905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:38.227555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405e35-ffdf-42e4-b0a4-0650f337afec None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:38.260860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:38.261652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:38.261981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:38.262306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:38.269859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:38.271295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:27:38.285467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:38.286557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:38.287575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 632/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:38.294211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:38.391989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ef0f2-b361-4dea-a27e-5ef367b0b8e5 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:38.426375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:38.427040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:38.427317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:38.427587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:38.428450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:38.428769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:38.430206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:38.446888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 649/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Thu May 12 14:27:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:38.452961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:38.551565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e173446-696a-45e0-9578-b949beea0d8f None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:38.584635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:38.585281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:38.585561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:38.585831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:38.652249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:38.653716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:38.750216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 633/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Thu May 12 14:27:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:27:38.756081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:38.865354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e608629-16e9-4e13-bac9-73bf3f881713 None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:38.899750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:38.900543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:38.900817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:38.901085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:38.912427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:38.913798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:27:38.931724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:38.932728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:38.933836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:27:38.933836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:27:38.933836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:27:38.933836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:38.933836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 650/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:38.938909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:39.046288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5b0e-e9c0-443f-955e-f6fd4d90bab0 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:39.089868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:39.090652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:39.091017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:39.091392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:39.092216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:39.092525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:39.093936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:39.106658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 634/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Thu May 12 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:39.112502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:39.218453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4d82-7ae7-4513-86b1-e0d65082522b None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:39.264181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:39.264983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:39.265268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:39.265546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:39.275855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:39.279274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:27:39.297737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application with Lock( May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:39.298837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:27:39.299992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: ERROR keystone.server.flask.application May 12 14:27:39.300478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 651/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Thu May 12 14:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:39.308587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:39.425860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5675e2-bef2-48a9-b0c0-5c16a198bb5a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:39.464668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:39.465592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:39.465878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:39.466148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:39.466936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:39.467244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:39.468785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e864e1-ac32-475e-93a7-3fc3019d6bd4 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:39.482188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 635/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Thu May 12 14:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:39.489425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:39.607541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8589-0131-4a71-8551-8287b46cb7ca None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:39.647094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:39.647783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:39.648063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:39.648339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:39.649183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] RBAC: Adding query filter params (role.id=2f57cc7438394c4089c6f602de8402b9, scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf, user.id=053ed1bdb47c44fc8c581c1485fde6c3) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:39.649501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:39.650962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b26b2-a63f-4746-9a83-f7c856672eea None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:39.657944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 652/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Thu May 12 14:27:39 2022] GET /identity/v3/role_assignments?user.id=053ed1bdb47c44fc8c581c1485fde6c3&scope.project.id=548da44dc2034c3eb7cb3df5fc2c3dcf&role.id=2f57cc7438394c4089c6f602de8402b9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:41.921881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a150-21e5-4197-8089-5c334eafd41d None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:41.922748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a150-21e5-4197-8089-5c334eafd41d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:41.922748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a150-21e5-4197-8089-5c334eafd41d None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:41.924968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 636/1288] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:41.931343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:41.932106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:41.932250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:41.957024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:41.958178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:42.046713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 653/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:42.071025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2a150-21e5-4197-8089-5c334eafd41d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:42.175218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2a150-21e5-4197-8089-5c334eafd41d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:42.209468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:42.210270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:42.210548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:42.210827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:42.211478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:42.212887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:42.224655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:42.225860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:42.227752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 637/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:27:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:42.233949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:42.339169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad3a4a-3257-418a-af44-212f4f068bcd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:42.376613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:42.377274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:42.377557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:42.377832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:42.378545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:42.378852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:42.380261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bce1-6634-4d5a-86db-ae4e43111f4e None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:42.385646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 654/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Thu May 12 14:27:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:42.394952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:42.507449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e652-4c58-4c99-85d7-9061683e5a93 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:42.541876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:42.542546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:42.542830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:42.543175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] PATH_INFO: `/v3/services` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:42.544212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:42.544521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:42.545899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d2ac3-e199-4153-bdbb-4fb3fe2a3dc8 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:42.550819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 638/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Thu May 12 14:27:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:44.721959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9538c-d808-44d2-833f-a4d6843f6b45 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:44.722592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9538c-d808-44d2-833f-a4d6843f6b45 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:44.722592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9538c-d808-44d2-833f-a4d6843f6b45 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:44.723901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 655/1293] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:44.730340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018bd10-3ab0-42bd-a616-c8249b770105 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:44.731163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018bd10-3ab0-42bd-a616-c8249b770105 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:44.731618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018bd10-3ab0-42bd-a616-c8249b770105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:44.756255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c018bd10-3ab0-42bd-a616-c8249b770105 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:44.757444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c018bd10-3ab0-42bd-a616-c8249b770105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:44.835906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 639/1294] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:44.858811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9538c-d808-44d2-833f-a4d6843f6b45 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:44.962977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9538c-d808-44d2-833f-a4d6843f6b45 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:45.005948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:45.006744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:45.007087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:45.007393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:45.008350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:45.009955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6593351-6229-4229-b38b-fb057be7cf4f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:45.028944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 656/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Thu May 12 14:27:44 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:27:47.266919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd0e0-223e-4d9d-a5a8-caff12de039f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:47.267538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd0e0-223e-4d9d-a5a8-caff12de039f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:47.267538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd0e0-223e-4d9d-a5a8-caff12de039f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:47.268940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 640/1296] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:47.275365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:47.276195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:47.276342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:47.300698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:47.301863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:47.397425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 657/1297] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:47.422239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd0e0-223e-4d9d-a5a8-caff12de039f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:47.538286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd0e0-223e-4d9d-a5a8-caff12de039f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:47.574501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:47.575296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:47.575576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:47.575882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:47.576545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:47.577912 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:47.590116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:47.591162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:47.592218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 641/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:27:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:47.600431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:47.707485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c6a26-9911-4f6e-b062-7e5fd72e29eb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:47.746863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:47.747517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:47.747823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:47.748090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:47.748787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:47.749083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:47.750442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:47.756066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 658/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Thu May 12 14:27:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:47.762449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:47.866065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab9ed-9fda-4503-ae5d-f03c69ca0a6a None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:47.899560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:47.900228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:47.900507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:47.900773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:47.901559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] RBAC: Adding query filter params (interface=public, service_id=cb0240a5a0854278ad0402dc5953168f, region_id=RegionOne) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:47.901868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:47.903458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb085c8-f9b1-4231-94a2-ba5b490afb07 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:47.911400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 642/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Thu May 12 14:27:47 2022] GET /identity/v3/endpoints?service_id=cb0240a5a0854278ad0402dc5953168f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:47.917101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:48.024131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8954a-36e8-4952-b586-30fe926695ad None admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:48.062824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:48.063491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:48.063796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:48.064068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:48.064744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:48.066131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67351df-e846-4b12-9386-00d514edea0f None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:48.072816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 659/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Thu May 12 14:27:47 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:27:50.260471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5da1-9647-4e4c-855b-8f26600bdc78 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:50.261370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5da1-9647-4e4c-855b-8f26600bdc78 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:50.261370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5da1-9647-4e4c-855b-8f26600bdc78 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:50.263970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 643/1302] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:27:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:50.270111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:50.270553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:50.270662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:50.296017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:50.297519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:50.366631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 660/1303] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:27:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:27:50.398476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5da1-9647-4e4c-855b-8f26600bdc78 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:50.510416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5da1-9647-4e4c-855b-8f26600bdc78 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:50.544722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:50.545467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:50.545747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:50.546022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:50.546991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:50.548402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:27:50.560975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:27:50.562115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application with Lock( May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self._enter() May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application return self.creator() May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application created_value = creator( May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: ERROR keystone.server.flask.application May 12 14:27:50.563062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 644/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Thu May 12 14:27:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:27:50.570377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:50.668803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d858f-5043-4537-b69d-c766de9de65a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:50.702748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:50.703400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:50.703675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:50.704001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] PATH_INFO: `/v3/services` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:50.704668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:50.704963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:50.706343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2784-d6dc-4a16-8940-622cdf3bc885 None admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:50.711443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 661/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Thu May 12 14:27:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:27:50.718905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:50.819599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c18c-e570-4278-9937-72864a6515f9 None admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:50.855617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:50.856287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:50.856564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:50.856831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:50.857559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:50.858915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa913e-2f62-4172-bf8b-381f6805ff6c None admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:50.879759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 645/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Thu May 12 14:27:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:28:55.341948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9fb0-aa0a-4010-a297-3702c9476d26 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:55.342459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9fb0-aa0a-4010-a297-3702c9476d26 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:55.342718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9fb0-aa0a-4010-a297-3702c9476d26 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:55.344450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 662/1307] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:28:55.350105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4de69-5c7d-42cc-92ae-75ac4bb7b071 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:55.350887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4de69-5c7d-42cc-92ae-75ac4bb7b071 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:55.351343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4de69-5c7d-42cc-92ae-75ac4bb7b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:55.435166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5da4de69-5c7d-42cc-92ae-75ac4bb7b071 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:28:55.436568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5da4de69-5c7d-42cc-92ae-75ac4bb7b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:55.582036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 646/1308] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:28:55.638812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:55.639342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:55.639802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:55.641829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 663/1309] 10.222.0.79 () {54 vars in 964 bytes} [Thu May 12 14:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:28:55.649316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf74e-abb7-42f7-acea-810c3389ed6a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:55.649720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf74e-abb7-42f7-acea-810c3389ed6a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:55.650109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cf74e-abb7-42f7-acea-810c3389ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:55.737689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-292cf74e-abb7-42f7-acea-810c3389ed6a None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:28:55.739080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-292cf74e-abb7-42f7-acea-810c3389ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:55.829051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 647/1310] 10.222.0.79 () {58 vars in 1061 bytes} [Thu May 12 14:28:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:28:55.837843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:28:55.839932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:55.965442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42bfb-db13-428c-adba-39e3a572adce None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:28:56.043590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:28:56.044585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:56.044966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:56.045328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:56.047426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:56.157934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:28:56.159459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5a5f4-2d19-45d0-b782-d24725111677 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:28:56.178778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 664/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:28:58.685762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:58.686733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:58.687287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:58.689054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 648/1312] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:28:58.694795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531599a3-36cc-4c53-8237-60712660fab8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:58.695599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531599a3-36cc-4c53-8237-60712660fab8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:58.696134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531599a3-36cc-4c53-8237-60712660fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:58.802691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-531599a3-36cc-4c53-8237-60712660fab8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:28:58.803921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-531599a3-36cc-4c53-8237-60712660fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:58.904021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 665/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:28:58.942933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:28:58.944635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:59.058463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8c7e-641d-4521-bfcd-194be79403a9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:28:59.133546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:28:59.134213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:28:59.134493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:28:59.134765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:28:59.136663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:28:59.246439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:28:59.247894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d789ef-2984-437f-a243-0ba21b963c5e service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:28:59.266245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 649/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:01.839340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf05e-1fbb-4509-b2ed-76abf9ddd51a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:01.839886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf05e-1fbb-4509-b2ed-76abf9ddd51a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:01.839997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf05e-1fbb-4509-b2ed-76abf9ddd51a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:01.841433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 666/1315] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:01.847016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7e94-21c3-4e88-a95c-e38813a3dfd0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:01.847474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7e94-21c3-4e88-a95c-e38813a3dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:01.847625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7e94-21c3-4e88-a95c-e38813a3dfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:01.921723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2d7a7e94-21c3-4e88-a95c-e38813a3dfd0 None None] MFA Rules not processed for user `b5cc0d3ae6204c1097ca734a1ae8b884`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:01.922998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2d7a7e94-21c3-4e88-a95c-e38813a3dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:02.034451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 650/1316] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:29:02.106498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27970-e743-4c0f-9399-24f132473740 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:02.106788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27970-e743-4c0f-9399-24f132473740 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:02.107103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27970-e743-4c0f-9399-24f132473740 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:02.108682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 667/1317] 10.222.0.79 () {54 vars in 964 bytes} [Thu May 12 14:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:29:02.114710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197303-5ef5-4e51-b87c-aae307c694fc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:02.115007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197303-5ef5-4e51-b87c-aae307c694fc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:02.115277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197303-5ef5-4e51-b87c-aae307c694fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:02.190919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fb197303-5ef5-4e51-b87c-aae307c694fc None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:02.192144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb197303-5ef5-4e51-b87c-aae307c694fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:02.267390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 651/1318] 10.222.0.79 () {58 vars in 1061 bytes} [Thu May 12 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:02.276521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead27970-e743-4c0f-9399-24f132473740 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:02.278084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ead27970-e743-4c0f-9399-24f132473740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:02.384152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead27970-e743-4c0f-9399-24f132473740 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:02.463502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:02.464227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:02.464510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:02.464783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:02.466461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:02.583349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:02.584825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3af91a-ae55-4e5e-bde1-f389a9c539ac service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:02.603338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 668/1319] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:05.757785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:05.758319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:05.758319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:05.759644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 652/1320] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:05.768948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691a3-ee9b-43cc-ae72-f054055a40d0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:05.769651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691a3-ee9b-43cc-ae72-f054055a40d0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:05.769842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691a3-ee9b-43cc-ae72-f054055a40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:05.846874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7e5691a3-ee9b-43cc-ae72-f054055a40d0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:05.848123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7e5691a3-ee9b-43cc-ae72-f054055a40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:05.948352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 669/1321] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:05.990669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:05.993126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:06.118344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3d3c-c83c-45f4-a87f-4f970dbe4026 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:06.201393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:06.202058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:06.202337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:06.202607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:06.204276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:06.332649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:06.334107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd075c-b895-44f9-800d-ea8832cb0d84 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:06.354940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 653/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:09.338626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.339199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.339296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.340699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 670/1323] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:09.346266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6e64-ee32-48ea-8041-114d567c7796 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.346722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6e64-ee32-48ea-8041-114d567c7796 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.346831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6e64-ee32-48ea-8041-114d567c7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.411550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-907c6e64-ee32-48ea-8041-114d567c7796 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:09.412790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-907c6e64-ee32-48ea-8041-114d567c7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:09.509684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 654/1324] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:09.544900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:09.546812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:09.648751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77393fe1-b5b1-40c6-b646-f42dddeb62d4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:09.725491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:09.726148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.726427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.726723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.728426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:09.837932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:09.839391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55285e6-c8c1-4138-8663-848153749c56 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:09.858577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 671/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:12.139188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:12.139818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:12.139818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:12.141180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 655/1326] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:12.146493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406972-2d4f-459c-bf06-3db8cd16f106 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:12.146943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406972-2d4f-459c-bf06-3db8cd16f106 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:12.147045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406972-2d4f-459c-bf06-3db8cd16f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:12.212682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f5406972-2d4f-459c-bf06-3db8cd16f106 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:12.214052 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f5406972-2d4f-459c-bf06-3db8cd16f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:12.313577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 672/1327] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:12.349045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:12.350590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:12.454541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f127d-fb40-4d2d-b7df-6479283c5ce9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:12.527394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:12.528084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:12.528366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:12.528641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:12.530272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:12.641342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:12.642813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf61402-e59d-4562-a6a8-d74a907a912d service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:12.661079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 656/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:14.948764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:14.949363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:14.949363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:14.950731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 673/1329] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:14.956466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398ed97-d634-4bbb-9ae0-3c1066162e36 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:14.956917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398ed97-d634-4bbb-9ae0-3c1066162e36 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:14.957135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398ed97-d634-4bbb-9ae0-3c1066162e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:15.032975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f398ed97-d634-4bbb-9ae0-3c1066162e36 None None] MFA Rules not processed for user `b5cc0d3ae6204c1097ca734a1ae8b884`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:15.034178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f398ed97-d634-4bbb-9ae0-3c1066162e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:15.132869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 657/1330] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:15.170767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:15.172361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:15.290350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86624c40-2312-424a-b4bd-f5297e739631 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:15.368075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:15.368732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:15.369078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:15.369385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:15.371027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:15.481504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:15.482997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9314-c37b-4761-8eba-770916ea61c5 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:15.501005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 674/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:17.977277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:17.977846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:17.977846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:17.979539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 658/1332] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:17.985284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c026c-541b-462b-854a-1bf418efea44 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:17.985812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c026c-541b-462b-854a-1bf418efea44 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:17.985812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c026c-541b-462b-854a-1bf418efea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:18.053107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-748c026c-541b-462b-854a-1bf418efea44 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:18.054206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-748c026c-541b-462b-854a-1bf418efea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:18.162681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 675/1333] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:18.211161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:18.212835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:18.332395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06785b-74f1-4531-b781-1a6711f605ef None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:18.418148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:18.419208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:18.419651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:18.420120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:18.423172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:18.547680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:18.549185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbd32-8cec-4cba-b399-39c43ad82f70 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:18.568661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 659/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:20.827529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:20.828287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:20.828425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:20.830711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 676/1335] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:20.836215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d724f-b47c-4b35-ab94-2118ba358040 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:20.836687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d724f-b47c-4b35-ab94-2118ba358040 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:20.836783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d724f-b47c-4b35-ab94-2118ba358040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:20.903918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b24d724f-b47c-4b35-ab94-2118ba358040 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:20.905146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b24d724f-b47c-4b35-ab94-2118ba358040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:21.006097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 660/1336] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:21.049120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:21.051599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:21.168469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7719300-a7a9-4e7e-8047-48845aee3afe None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:21.241191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:21.241858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:21.242126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:21.242402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:21.244106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:21.355703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:21.357217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed770002-eda8-4992-a0c7-cef55f0d3415 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:21.377018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 677/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:23.925309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:23.925880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:23.925880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:23.927409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 661/1338] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:23.933105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0890-bfbb-4fd8-a904-7dc58c242510 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:23.933582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0890-bfbb-4fd8-a904-7dc58c242510 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:23.933686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0890-bfbb-4fd8-a904-7dc58c242510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:24.012263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-944a0890-bfbb-4fd8-a904-7dc58c242510 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:24.013478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-944a0890-bfbb-4fd8-a904-7dc58c242510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:24.115480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 678/1339] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:24.154280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:24.155917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:24.276709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef608-3eda-401e-b760-0072082c5cfa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:24.363105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:24.363795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:24.364080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:24.364347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:24.366061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:24.485054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:24.486557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89ff49-7b5c-4182-95e3-47e3a37d0967 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:24.505583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 662/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:28.943322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:28.943931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:28.943931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:28.945178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 679/1341] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:28.950758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc49af-b153-4101-baee-4298cbde31e9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:28.951229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc49af-b153-4101-baee-4298cbde31e9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:28.951369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc49af-b153-4101-baee-4298cbde31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:29.034907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-07cc49af-b153-4101-baee-4298cbde31e9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:29.036061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-07cc49af-b153-4101-baee-4298cbde31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:29.148551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 663/1342] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:29.190564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:29.192888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:29.301480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee54ed-56e6-42d6-afa4-8466da377f92 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:29.305495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:29.306203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:29.306520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:29.306795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:29.316302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:29.317757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9aa73-75e7-4cff-baad-7c2e6f30abf4 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:29.328159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 680/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:29:32.169073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872233e-13aa-4db4-9b00-2ffe62d326b4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:32.169642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872233e-13aa-4db4-9b00-2ffe62d326b4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:32.169642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872233e-13aa-4db4-9b00-2ffe62d326b4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:32.171445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 664/1344] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:32.176586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4fcd-cc05-4614-a255-6513cc84b4b2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:32.177015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4fcd-cc05-4614-a255-6513cc84b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:32.177128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4fcd-cc05-4614-a255-6513cc84b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:32.206602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fd1f4fcd-cc05-4614-a255-6513cc84b4b2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:32.207839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fd1f4fcd-cc05-4614-a255-6513cc84b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:32.287418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 681/1345] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:32.324644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872233e-13aa-4db4-9b00-2ffe62d326b4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:32.336579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872233e-13aa-4db4-9b00-2ffe62d326b4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:32.340404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:32.341039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:32.341316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:32.341585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:32.350603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:32.352152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e961d2-99da-4930-b612-64cfa612b1dc service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:32.365211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 665/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:36.900332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0b659-ddfb-4a58-b0e2-1f85adbce0cf None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:36.900894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0b659-ddfb-4a58-b0e2-1f85adbce0cf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:36.900975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0b659-ddfb-4a58-b0e2-1f85adbce0cf None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:36.902590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 682/1347] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:36.907909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c9067-cade-4d17-b542-6a2da1f9d931 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:36.908356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c9067-cade-4d17-b542-6a2da1f9d931 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:36.908460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c9067-cade-4d17-b542-6a2da1f9d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:36.927962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5d3c9067-cade-4d17-b542-6a2da1f9d931 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:36.929173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5d3c9067-cade-4d17-b542-6a2da1f9d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:36.941216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 666/1348] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:36.979988 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0b659-ddfb-4a58-b0e2-1f85adbce0cf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:36.993177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0b659-ddfb-4a58-b0e2-1f85adbce0cf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:36.998697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:36.999355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:36.999645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:36.999966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:37.010213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:37.011672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb047d-39a1-47ce-9075-4456be0cc712 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:37.021684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 683/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:42.463818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53dfa-4f86-4e79-a62c-27cec5df629a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:42.464739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53dfa-4f86-4e79-a62c-27cec5df629a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:42.465234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53dfa-4f86-4e79-a62c-27cec5df629a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:42.467091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 667/1350] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:42.471922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903fcf9-6c93-45ee-a5ec-ee5d594772f4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:42.472672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903fcf9-6c93-45ee-a5ec-ee5d594772f4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:42.473093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903fcf9-6c93-45ee-a5ec-ee5d594772f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:42.552654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1903fcf9-6c93-45ee-a5ec-ee5d594772f4 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:42.554193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1903fcf9-6c93-45ee-a5ec-ee5d594772f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:42.631864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 684/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:29:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:47.102203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549573e-8d61-4dba-8270-c106a71d9e74 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:47.102852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549573e-8d61-4dba-8270-c106a71d9e74 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:47.102852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549573e-8d61-4dba-8270-c106a71d9e74 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:47.104689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 668/1352] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:47.109566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098b50-8cc7-4af8-8de6-d0e660dd89d7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:47.110087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098b50-8cc7-4af8-8de6-d0e660dd89d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:47.110181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098b50-8cc7-4af8-8de6-d0e660dd89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:47.128713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bb098b50-8cc7-4af8-8de6-d0e660dd89d7 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:47.130000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bb098b50-8cc7-4af8-8de6-d0e660dd89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:47.139720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 685/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:29:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:48.702875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d4a0-db76-46dc-9a85-2e16c69dd128 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:48.703521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d4a0-db76-46dc-9a85-2e16c69dd128 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:48.703521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9d4a0-db76-46dc-9a85-2e16c69dd128 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:48.705140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 669/1354] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:48.710350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f1b1-1077-46f2-a6f8-12c0ed93d696 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:48.710771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f1b1-1077-46f2-a6f8-12c0ed93d696 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:48.710929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f1b1-1077-46f2-a6f8-12c0ed93d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:48.729335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ad83f1b1-1077-46f2-a6f8-12c0ed93d696 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:48.730491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ad83f1b1-1077-46f2-a6f8-12c0ed93d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:48.739532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 686/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:52.464329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80d3a-e550-40a8-9d96-113aeef7d8e4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:52.464904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80d3a-e550-40a8-9d96-113aeef7d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:52.464904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80d3a-e550-40a8-9d96-113aeef7d8e4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:52.466207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 670/1356] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:52.472119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ebb3-0fd9-4bdb-980b-26d75f33da3e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:52.472992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ebb3-0fd9-4bdb-980b-26d75f33da3e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:52.473377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ebb3-0fd9-4bdb-980b-26d75f33da3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:52.492453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3390ebb3-0fd9-4bdb-980b-26d75f33da3e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:52.493722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3390ebb3-0fd9-4bdb-980b-26d75f33da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:52.502364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 687/1357] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:52.550262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca8e4-91a4-4f60-8056-5cddee0001c8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:52.550764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca8e4-91a4-4f60-8056-5cddee0001c8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:52.551174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca8e4-91a4-4f60-8056-5cddee0001c8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:52.552884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 671/1358] 10.222.0.79 () {54 vars in 961 bytes} [Thu May 12 14:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:52.558761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce679-4bf5-42c6-b28f-a36d13b4aba2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:52.559150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce679-4bf5-42c6-b28f-a36d13b4aba2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:52.559516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfce679-4bf5-42c6-b28f-a36d13b4aba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:52.610268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3bfce679-4bf5-42c6-b28f-a36d13b4aba2 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:52.611638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3bfce679-4bf5-42c6-b28f-a36d13b4aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:52.716238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 688/1359] 10.222.0.79 () {58 vars in 1058 bytes} [Thu May 12 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:52.724605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ca8e4-91a4-4f60-8056-5cddee0001c8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:52.740350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ca8e4-91a4-4f60-8056-5cddee0001c8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:52.746561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:52.747479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:52.747998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:52.748503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:52.757518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:52.759427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac71fc4-d1c9-4b58-88d5-c2a70f555a13 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:52.769982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 672/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:55.177608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356d89-5885-4ff6-8a7e-436595499bd7 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:55.178185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356d89-5885-4ff6-8a7e-436595499bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:55.178185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356d89-5885-4ff6-8a7e-436595499bd7 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:55.179482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 689/1361] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:55.185152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac517e-613a-4d14-8a93-5d53f9452977 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:55.185611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac517e-613a-4d14-8a93-5d53f9452977 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:55.185690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac517e-613a-4d14-8a93-5d53f9452977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:55.203365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-42ac517e-613a-4d14-8a93-5d53f9452977 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:55.204586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-42ac517e-613a-4d14-8a93-5d53f9452977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:55.212818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 673/1362] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:55.256061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356d89-5885-4ff6-8a7e-436595499bd7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:55.270612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356d89-5885-4ff6-8a7e-436595499bd7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:55.276422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:55.277067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:55.277344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:55.277600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:55.285950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:55.287529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331db22-a1b1-4437-a1da-7189b3d068b1 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:55.297708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 690/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:57.805633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098e83-9186-43c8-bcf3-519cd0ad6d02 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:57.806162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098e83-9186-43c8-bcf3-519cd0ad6d02 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:57.806162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f098e83-9186-43c8-bcf3-519cd0ad6d02 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:57.807556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 674/1364] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:57.813073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eba58-706b-4f11-bd64-cd16121d73ed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:57.813517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eba58-706b-4f11-bd64-cd16121d73ed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:57.813620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eba58-706b-4f11-bd64-cd16121d73ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:57.835427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0d6eba58-706b-4f11-bd64-cd16121d73ed None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:57.836698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0d6eba58-706b-4f11-bd64-cd16121d73ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:57.845507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 691/1365] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:57.890333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65dbb-ae18-47bb-8a04-74f037e1313f None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:57.890731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65dbb-ae18-47bb-8a04-74f037e1313f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:57.891034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65dbb-ae18-47bb-8a04-74f037e1313f None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:57.892440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 675/1366] 10.222.0.79 () {54 vars in 961 bytes} [Thu May 12 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:57.897664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecacb-12fd-4879-bfe8-d513ddb58b27 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:57.897904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecacb-12fd-4879-bfe8-d513ddb58b27 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:57.898181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecacb-12fd-4879-bfe8-d513ddb58b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:57.919172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-770ecacb-12fd-4879-bfe8-d513ddb58b27 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:57.920735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-770ecacb-12fd-4879-bfe8-d513ddb58b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:57.932110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 692/1367] 10.222.0.79 () {58 vars in 1058 bytes} [Thu May 12 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:57.940718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b65dbb-ae18-47bb-8a04-74f037e1313f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:57.957428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b65dbb-ae18-47bb-8a04-74f037e1313f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:57.963061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:57.963857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:57.964208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:57.964550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:57.973036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:57.974640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02379-2b10-4452-93c8-a275b3fdce63 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:57.985501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 676/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:00.278941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f762d-911c-4a1e-812c-319165e9f6e6 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:00.279596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f762d-911c-4a1e-812c-319165e9f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:00.279596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f762d-911c-4a1e-812c-319165e9f6e6 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:00.280885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 693/1369] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:00.286538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b344-75c1-418f-a965-143e2d830de7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:00.287024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b344-75c1-418f-a965-143e2d830de7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:00.287240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b344-75c1-418f-a965-143e2d830de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:00.306651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4686b344-75c1-418f-a965-143e2d830de7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:00.307853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4686b344-75c1-418f-a965-143e2d830de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:00.316120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 677/1370] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:00.359606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f762d-911c-4a1e-812c-319165e9f6e6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:00.375251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f762d-911c-4a1e-812c-319165e9f6e6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:00.381339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:00.381980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:00.382265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:00.382533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:00.391169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:00.392804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f6c6-3e8a-404b-af9a-1ed9fd26525f service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:00.402366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 694/1371] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:00.721224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409904c-3c35-49f7-ab94-7260561b67a3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:00.721485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409904c-3c35-49f7-ab94-7260561b67a3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:00.721735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409904c-3c35-49f7-ab94-7260561b67a3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:00.724965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 678/1372] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:00.730032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc88b-1be5-46fb-9177-118f44cf6745 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:00.730289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc88b-1be5-46fb-9177-118f44cf6745 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:00.730750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc88b-1be5-46fb-9177-118f44cf6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:00.750671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0a4fc88b-1be5-46fb-9177-118f44cf6745 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:00.751943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a4fc88b-1be5-46fb-9177-118f44cf6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:00.760796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 695/1373] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:01.035672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b065-b988-4039-98e3-a89c40b4c329 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:01.036329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b065-b988-4039-98e3-a89c40b4c329 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:01.036699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9b065-b988-4039-98e3-a89c40b4c329 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:01.038270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 679/1374] 10.222.0.79 () {54 vars in 963 bytes} [Thu May 12 14:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:01.043864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df4f5-f315-4f3e-86c4-67e8cb0e3e5a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:01.044384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df4f5-f315-4f3e-86c4-67e8cb0e3e5a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:01.044722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df4f5-f315-4f3e-86c4-67e8cb0e3e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:01.096730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a29df4f5-f315-4f3e-86c4-67e8cb0e3e5a None None] MFA Rules not processed for user `acb6ff788d5841a3b627c60feaf44d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:01.098013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a29df4f5-f315-4f3e-86c4-67e8cb0e3e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:01.160259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 696/1375] 10.222.0.79 () {58 vars in 1060 bytes} [Thu May 12 14:30:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:01.168185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9b065-b988-4039-98e3-a89c40b4c329 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:01.179718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9b065-b988-4039-98e3-a89c40b4c329 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:01.183973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:01.184846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:01.185224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:01.185596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:01.195917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:01.197928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd78d7-4292-4dc7-8c33-c50dfb1360c3 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:01.208758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 680/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:02.671388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec657-4d64-4544-9009-292c4b7487ff None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:02.671969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec657-4d64-4544-9009-292c4b7487ff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:02.671969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec657-4d64-4544-9009-292c4b7487ff None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:02.673319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 697/1377] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:02.679233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec328-0424-402e-bf8c-42033ee86c8b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:02.680165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec328-0424-402e-bf8c-42033ee86c8b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:02.680501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec328-0424-402e-bf8c-42033ee86c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:02.699514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-874ec328-0424-402e-bf8c-42033ee86c8b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:02.700752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-874ec328-0424-402e-bf8c-42033ee86c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:02.710276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 681/1378] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:02.759082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec657-4d64-4544-9009-292c4b7487ff None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:02.774115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec657-4d64-4544-9009-292c4b7487ff None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:02.780650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:02.781338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:02.781618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:02.781887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:02.792227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:02.793863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20efa0-fcb0-4f14-b14f-207ed253a8aa service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:02.806111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 698/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:05.128760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a117-b09a-478f-8a22-a197d3cf53f8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:05.129610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a117-b09a-478f-8a22-a197d3cf53f8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:05.130038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a117-b09a-478f-8a22-a197d3cf53f8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:05.135751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 682/1380] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:05.137282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adbf4-b42e-494c-b6ee-fe808ab98b00 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:05.138119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adbf4-b42e-494c-b6ee-fe808ab98b00 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:05.138586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adbf4-b42e-494c-b6ee-fe808ab98b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:05.160944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e22adbf4-b42e-494c-b6ee-fe808ab98b00 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:05.162389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e22adbf4-b42e-494c-b6ee-fe808ab98b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:05.175274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 699/1381] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:05.214675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a117-b09a-478f-8a22-a197d3cf53f8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:05.230530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a117-b09a-478f-8a22-a197d3cf53f8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:05.236485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:05.237148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:05.237432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:05.237708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:05.246895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:05.248523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5012-229d-4dbc-8d25-dc5cc8da82ef service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:05.259857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 683/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:07.512837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc001ab-c6b0-4a31-bf3d-f808b28fcfff None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:07.513375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc001ab-c6b0-4a31-bf3d-f808b28fcfff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:07.513375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc001ab-c6b0-4a31-bf3d-f808b28fcfff None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:07.514989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 700/1383] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:07.520713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b52e-8498-4f4a-aba1-3b8057fc51fb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:07.521549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b52e-8498-4f4a-aba1-3b8057fc51fb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:07.521729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b52e-8498-4f4a-aba1-3b8057fc51fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:07.541819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1530b52e-8498-4f4a-aba1-3b8057fc51fb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:07.543028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1530b52e-8498-4f4a-aba1-3b8057fc51fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:07.552152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 684/1384] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:07.595258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc001ab-c6b0-4a31-bf3d-f808b28fcfff None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:07.611659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc001ab-c6b0-4a31-bf3d-f808b28fcfff None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:07.620125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:07.621015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:07.621399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:07.621775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:07.630855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:07.632745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eaa0f-ccc2-4409-b97a-b485d73aee4f service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:07.642884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 701/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:09.910944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b13f-db86-4300-ad9b-fcf693548901 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:09.911507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b13f-db86-4300-ad9b-fcf693548901 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:09.911507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b13f-db86-4300-ad9b-fcf693548901 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:09.913004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 685/1386] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:09.919722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb413a6-ac8c-4f9d-960e-31324168ece3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:09.920224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb413a6-ac8c-4f9d-960e-31324168ece3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:09.920648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb413a6-ac8c-4f9d-960e-31324168ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:09.939274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5fb413a6-ac8c-4f9d-960e-31324168ece3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:09.940567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5fb413a6-ac8c-4f9d-960e-31324168ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:09.949117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 702/1387] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:09.996283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b13f-db86-4300-ad9b-fcf693548901 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:10.011614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b13f-db86-4300-ad9b-fcf693548901 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:10.017418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:10.018268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:10.018552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:10.018824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:10.028411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:10.030032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b766305-6b4b-4f11-8d37-8f385049ad80 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:10.039799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 686/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:30:12.387719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eef9f-ecc2-4ee8-a7af-36152085629d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:12.388309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eef9f-ecc2-4ee8-a7af-36152085629d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:12.388639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eef9f-ecc2-4ee8-a7af-36152085629d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:12.390474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 703/1389] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:12.396753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54a26-8a62-40f2-b82e-e03178d6e31b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:12.397300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54a26-8a62-40f2-b82e-e03178d6e31b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:12.397300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c54a26-8a62-40f2-b82e-e03178d6e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:12.416481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-88c54a26-8a62-40f2-b82e-e03178d6e31b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:12.417681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-88c54a26-8a62-40f2-b82e-e03178d6e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:12.426950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 687/1390] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:12.471309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eef9f-ecc2-4ee8-a7af-36152085629d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:12.488373 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eef9f-ecc2-4ee8-a7af-36152085629d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:12.493946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:12.494600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:12.494870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:12.495141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:12.503627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:12.505271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07b59-d2e0-4121-89ef-81e7ba587f58 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:12.514558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 704/1391] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:14.756212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c6f8b-8760-4679-9c47-dd2f0b3fd816 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:14.756900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c6f8b-8760-4679-9c47-dd2f0b3fd816 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:14.756900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c6f8b-8760-4679-9c47-dd2f0b3fd816 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:14.758138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 688/1392] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:14.764165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5c78-f4b4-4a9d-bb4d-cf8340a91b5e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:14.764660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5c78-f4b4-4a9d-bb4d-cf8340a91b5e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:14.764876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b5c78-f4b4-4a9d-bb4d-cf8340a91b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:14.787172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cf1b5c78-f4b4-4a9d-bb4d-cf8340a91b5e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:14.788803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf1b5c78-f4b4-4a9d-bb4d-cf8340a91b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:14.799231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 705/1393] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:14.846704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c6f8b-8760-4679-9c47-dd2f0b3fd816 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:14.861804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c6f8b-8760-4679-9c47-dd2f0b3fd816 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:14.867605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:14.868572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:14.868913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:14.869189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:14.878097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:14.879670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2935f00-394f-46f6-a4bc-1e231f4dc042 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:14.889338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 689/1394] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:16.961297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2b5d-a34d-47ab-bff8-2a41e4ba8707 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:16.962244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2b5d-a34d-47ab-bff8-2a41e4ba8707 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:16.962244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2b5d-a34d-47ab-bff8-2a41e4ba8707 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:16.963323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 706/1395] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:16.969729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2eb29-acfd-419f-8158-839a975479d9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:16.970309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2eb29-acfd-419f-8158-839a975479d9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:16.970309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2eb29-acfd-419f-8158-839a975479d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:16.991994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6fe2eb29-acfd-419f-8158-839a975479d9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:16.993322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6fe2eb29-acfd-419f-8158-839a975479d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:17.002161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 690/1396] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:17.059413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e70ec-eac2-4fa3-a879-d45bb4e03bc8 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.059922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e70ec-eac2-4fa3-a879-d45bb4e03bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.060444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e70ec-eac2-4fa3-a879-d45bb4e03bc8 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.062687 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 707/1397] 10.222.0.79 () {54 vars in 962 bytes} [Thu May 12 14:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:17.068095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.068393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.068674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.120242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] MFA Rules not processed for user `f11c04b2350b44c6a9dd95acf914fc69`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:17.121426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:17.153649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b6c8-07ce-40e5-b6c4-aed86999ea84 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.153952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b6c8-07ce-40e5-b6c4-aed86999ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.154335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b6c8-07ce-40e5-b6c4-aed86999ea84 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.156475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 708/1398] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:17.163266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.163629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.164000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.182623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:17.184186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:17.186414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 691/1399] 10.222.0.79 () {58 vars in 1059 bytes} [Thu May 12 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:17.193887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:17.194665 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 709/1400] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:17.202036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2899121-e3da-49ed-81c7-0b0913d3bb7a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:17.205920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:17.206572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.206849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.207120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.216406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:17.217836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9279-d15f-405a-88d5-51aa6b68083f service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:17.227676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 692/1401] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:30:17.238177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:17.251353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbac6fa-4dcd-4531-8da3-018fefce773d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:17.259005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:17.259746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.260131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.260475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.269627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:17.271233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4198e-a5bc-4e81-b8ad-3e65ba5fae04 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:17.281255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 710/1402] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:17.673254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c8f5-1646-4ec2-846f-9798add2f68d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.673547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c8f5-1646-4ec2-846f-9798add2f68d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.673827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c8f5-1646-4ec2-846f-9798add2f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.723957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9cc2c8f5-1646-4ec2-846f-9798add2f68d None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:17.725183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9cc2c8f5-1646-4ec2-846f-9798add2f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:17.792528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 693/1403] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:17.841413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801a7-0044-4809-be7b-e9649c34a3dc None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.841803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801a7-0044-4809-be7b-e9649c34a3dc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.842198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801a7-0044-4809-be7b-e9649c34a3dc None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.843718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 711/1404] 10.222.0.79 () {54 vars in 942 bytes} [Thu May 12 14:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:17.850638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2723f-7a6d-454b-8603-492e159c22d0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:17.850931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2723f-7a6d-454b-8603-492e159c22d0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:17.851210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2723f-7a6d-454b-8603-492e159c22d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:17.900931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f5e2723f-7a6d-454b-8603-492e159c22d0 None None] MFA Rules not processed for user `8771b05277f14efa9650690aae4587f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:17.902124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f5e2723f-7a6d-454b-8603-492e159c22d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:17.978598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 694/1405] 10.222.0.79 () {58 vars in 1039 bytes} [Thu May 12 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:17.989658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569801a7-0044-4809-be7b-e9649c34a3dc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:18.005387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569801a7-0044-4809-be7b-e9649c34a3dc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:18.010720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:18.011448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:18.011829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:18.012171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:18.020397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:18.022070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ee0d7-6c5c-4d17-afab-37f0cd0dfedf service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:18.030727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 712/1406] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:30:19.564878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d871-1632-4bcf-88d4-02c599012c63 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:19.565863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d871-1632-4bcf-88d4-02c599012c63 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:19.566208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84d871-1632-4bcf-88d4-02c599012c63 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:19.567750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 695/1407] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:19.574817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a340-e1fc-4338-be5e-b68cdae9a8a6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:19.576328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a340-e1fc-4338-be5e-b68cdae9a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:19.576764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a340-e1fc-4338-be5e-b68cdae9a8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:19.618664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46b4a340-e1fc-4338-be5e-b68cdae9a8a6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:19.622706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46b4a340-e1fc-4338-be5e-b68cdae9a8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:19.639750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 713/1408] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:19.694110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84d871-1632-4bcf-88d4-02c599012c63 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:19.724800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84d871-1632-4bcf-88d4-02c599012c63 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:19.730625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:19.731287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:19.731567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:19.731875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:19.741125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:19.742867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc28506-7ab8-4226-8f60-ab2b35cb31b5 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:19.754063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 696/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:41.136536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b15-c529-49da-ad35-3be76778c2d1 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:41.137242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b15-c529-49da-ad35-3be76778c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:41.137242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b15-c529-49da-ad35-3be76778c2d1 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:41.138969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 714/1410] 10.222.0.79 () {54 vars in 918 bytes} [Thu May 12 14:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:41.147871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90fa5-3428-482a-ae44-0a066d629e77 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:41.148385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90fa5-3428-482a-ae44-0a066d629e77 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:41.148385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90fa5-3428-482a-ae44-0a066d629e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:41.169151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-87d90fa5-3428-482a-ae44-0a066d629e77 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:41.170336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-87d90fa5-3428-482a-ae44-0a066d629e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:41.181029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 697/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Thu May 12 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:41.197980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb6b9-a01f-4c53-b801-369d1c51e37d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:41.198267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb6b9-a01f-4c53-b801-369d1c51e37d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:41.198542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb6b9-a01f-4c53-b801-369d1c51e37d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:41.199937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 715/1412] 10.222.0.79 () {54 vars in 918 bytes} [Thu May 12 14:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:41.204756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20194-eda2-4691-b92a-5ad3ce25c4d9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:41.205047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20194-eda2-4691-b92a-5ad3ce25c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:41.205326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a20194-eda2-4691-b92a-5ad3ce25c4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:41.225316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-95a20194-eda2-4691-b92a-5ad3ce25c4d9 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:41.226479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-95a20194-eda2-4691-b92a-5ad3ce25c4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:41.236670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 698/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Thu May 12 14:30:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:43.915143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f69a8-3264-4ded-ab1c-8145ef806741 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:43.916246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f69a8-3264-4ded-ab1c-8145ef806741 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:43.916246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f69a8-3264-4ded-ab1c-8145ef806741 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:43.918411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:43.928112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df83e-2f70-4583-85fa-54b142a674b3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:43.929019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df83e-2f70-4583-85fa-54b142a674b3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:43.929019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df83e-2f70-4583-85fa-54b142a674b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:43.948611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3e1df83e-2f70-4583-85fa-54b142a674b3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:43.949793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3e1df83e-2f70-4583-85fa-54b142a674b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:43.959120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:44.001338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f69a8-3264-4ded-ab1c-8145ef806741 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:44.018681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f69a8-3264-4ded-ab1c-8145ef806741 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:44.026606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:44.027248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:44.027531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:44.027845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:44.036223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:44.037825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09a4de-7bb1-410d-ad32-b4eb2f2aec07 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:44.048302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 717/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:45.137201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a36e-befb-49c4-be78-7e48ac99eb76 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:45.137820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a36e-befb-49c4-be78-7e48ac99eb76 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:45.137820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a36e-befb-49c4-be78-7e48ac99eb76 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:45.139790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:45.147627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b7-2b1b-4b47-839a-1a0c1327ba7e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:45.148108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b7-2b1b-4b47-839a-1a0c1327ba7e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:45.148215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b7-2b1b-4b47-839a-1a0c1327ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:45.173041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7c08d1b7-2b1b-4b47-839a-1a0c1327ba7e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:45.174254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7c08d1b7-2b1b-4b47-839a-1a0c1327ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:45.183939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:45.358249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07a36e-befb-49c4-be78-7e48ac99eb76 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:45.378671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07a36e-befb-49c4-be78-7e48ac99eb76 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:45.385026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:45.385670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:45.385952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:45.386213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:45.395189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:45.396777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaeb67-d547-4b3e-b6cb-6bb75eac560f service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:45.407061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 701/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:46.383986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a98-b1d0-46af-a314-0b9a3838b01e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:46.384677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a98-b1d0-46af-a314-0b9a3838b01e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:46.384677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab64a98-b1d0-46af-a314-0b9a3838b01e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:46.385924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:46.391944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a05d4-4029-4fdf-ac27-c0cc0ebc36b6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:46.392635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a05d4-4029-4fdf-ac27-c0cc0ebc36b6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:46.392751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a05d4-4029-4fdf-ac27-c0cc0ebc36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:46.418667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-be1a05d4-4029-4fdf-ac27-c0cc0ebc36b6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:46.419918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-be1a05d4-4029-4fdf-ac27-c0cc0ebc36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:46.428774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:46.584425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab64a98-b1d0-46af-a314-0b9a3838b01e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:46.601516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab64a98-b1d0-46af-a314-0b9a3838b01e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:46.608318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:46.608966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:46.609245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:46.609524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:46.618268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:46.619919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce963-32f3-4971-9616-d9c065cc3a0a service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:46.629799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 720/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:47.572398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cf1f-ac50-46e5-bb40-5768ab8bf639 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:47.572949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cf1f-ac50-46e5-bb40-5768ab8bf639 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:47.572949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cf1f-ac50-46e5-bb40-5768ab8bf639 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:47.575056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:47.583558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97058f6-38e7-446d-af05-6ea93b4477f5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:47.584004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97058f6-38e7-446d-af05-6ea93b4477f5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:47.584191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97058f6-38e7-446d-af05-6ea93b4477f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:47.604582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b97058f6-38e7-446d-af05-6ea93b4477f5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:47.605781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b97058f6-38e7-446d-af05-6ea93b4477f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:47.614927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:47.766863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cf1f-ac50-46e5-bb40-5768ab8bf639 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:47.785294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cf1f-ac50-46e5-bb40-5768ab8bf639 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:47.792015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:47.792695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:47.792967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:47.793236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:47.802083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:47.803709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ade05d-934c-4f8f-a2c4-bf72e7340a75 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:47.813388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 704/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:48.745417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49b1a-687d-4dd3-8da4-0616abf6f475 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:48.746355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49b1a-687d-4dd3-8da4-0616abf6f475 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:48.746355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49b1a-687d-4dd3-8da4-0616abf6f475 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:48.748600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:48.753941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532b01-586d-45bf-9d51-d3f119ca1b23 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:48.754429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532b01-586d-45bf-9d51-d3f119ca1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:48.754513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532b01-586d-45bf-9d51-d3f119ca1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:48.775094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5b532b01-586d-45bf-9d51-d3f119ca1b23 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:48.776302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5b532b01-586d-45bf-9d51-d3f119ca1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:48.784732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:48.944491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49b1a-687d-4dd3-8da4-0616abf6f475 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:48.960817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49b1a-687d-4dd3-8da4-0616abf6f475 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:48.967934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:48.968579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:48.968864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:48.969140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:48.977669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:48.979267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24c922-37ac-4ed4-bd04-2cc1af84c377 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:48.988646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 723/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:49.861453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81caf8-9b4c-4d0d-a833-a2a1bb0f8788 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:49.861993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81caf8-9b4c-4d0d-a833-a2a1bb0f8788 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:49.861993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81caf8-9b4c-4d0d-a833-a2a1bb0f8788 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:49.863466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:49.869093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bf8a-afd9-46f2-991b-ccadb65aabc6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:49.869577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bf8a-afd9-46f2-991b-ccadb65aabc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:49.869693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bf8a-afd9-46f2-991b-ccadb65aabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:49.890100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-57c7bf8a-afd9-46f2-991b-ccadb65aabc6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:49.891294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57c7bf8a-afd9-46f2-991b-ccadb65aabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:49.901047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:50.050858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81caf8-9b4c-4d0d-a833-a2a1bb0f8788 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:50.071536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81caf8-9b4c-4d0d-a833-a2a1bb0f8788 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:50.077674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:50.078287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:50.078579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:50.078856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:50.088386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:50.090008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc9f9-f3d8-4625-aad8-613cdce742cd service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:50.099714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 707/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:50.972805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62ebc-6354-49f6-b66a-c54c0d1e9c6d None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:50.973728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62ebc-6354-49f6-b66a-c54c0d1e9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:50.973728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62ebc-6354-49f6-b66a-c54c0d1e9c6d None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:50.976088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:50.982346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa466af-f123-423d-bc58-35910f7797d8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:50.982892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa466af-f123-423d-bc58-35910f7797d8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:50.982892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa466af-f123-423d-bc58-35910f7797d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:51.002888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5aa466af-f123-423d-bc58-35910f7797d8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:51.004842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5aa466af-f123-423d-bc58-35910f7797d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:51.015723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:51.169713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62ebc-6354-49f6-b66a-c54c0d1e9c6d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:51.191447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62ebc-6354-49f6-b66a-c54c0d1e9c6d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:51.197516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:51.198168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:51.198415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:51.198711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:51.206938 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:51.208557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d956-510d-4358-a102-e6bee711c7c2 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:51.217878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 726/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:52.088426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c6d6-e58a-4aa6-ba0d-a82ad78f238b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:52.088989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c6d6-e58a-4aa6-ba0d-a82ad78f238b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:52.088989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c6d6-e58a-4aa6-ba0d-a82ad78f238b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:52.090380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:52.095668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5869-bcba-45b1-aeaa-6bcb7633b450 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:52.096157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5869-bcba-45b1-aeaa-6bcb7633b450 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:52.096252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef5869-bcba-45b1-aeaa-6bcb7633b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:52.123155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a1ef5869-bcba-45b1-aeaa-6bcb7633b450 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:52.124395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a1ef5869-bcba-45b1-aeaa-6bcb7633b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:52.132841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:52.284540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4c6d6-e58a-4aa6-ba0d-a82ad78f238b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:52.308764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4c6d6-e58a-4aa6-ba0d-a82ad78f238b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:52.315451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:52.316134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:52.316409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:52.316677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:52.326285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:52.327932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a90fc-9bdc-422b-bf75-0ce54443ea52 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:52.339493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 710/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:53.205758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d95b-a5e9-4f50-9b8a-5e84f709f141 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:53.206602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d95b-a5e9-4f50-9b8a-5e84f709f141 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:53.206602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d95b-a5e9-4f50-9b8a-5e84f709f141 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:53.208901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:30:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:53.217036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d403-ed29-4487-a081-1b0150097a0d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:53.217510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d403-ed29-4487-a081-1b0150097a0d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:53.217616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d403-ed29-4487-a081-1b0150097a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:53.237171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e4b5d403-ed29-4487-a081-1b0150097a0d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:53.238358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e4b5d403-ed29-4487-a081-1b0150097a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:53.247433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:30:53.404277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d95b-a5e9-4f50-9b8a-5e84f709f141 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:53.427045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d95b-a5e9-4f50-9b8a-5e84f709f141 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:53.437514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:53.438424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:53.438783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:53.439127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:53.450568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:53.452212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265a20-f351-4fd5-99de-519655e84ec2 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:53.462247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 729/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:55.593556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f375-0fe8-4ca7-a866-e4d34887d2d9 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:55.594506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f375-0fe8-4ca7-a866-e4d34887d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:55.594506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f375-0fe8-4ca7-a866-e4d34887d2d9 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:55.596901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:55.605296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a77e-6461-49b3-8ff3-9e38d169ab0a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:55.605743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a77e-6461-49b3-8ff3-9e38d169ab0a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:55.605854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a77e-6461-49b3-8ff3-9e38d169ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:55.624334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2227a77e-6461-49b3-8ff3-9e38d169ab0a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:55.625541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2227a77e-6461-49b3-8ff3-9e38d169ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:55.634244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:55.677921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f375-0fe8-4ca7-a866-e4d34887d2d9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:55.697011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f375-0fe8-4ca7-a866-e4d34887d2d9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:55.701772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:55.702460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:55.702739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:55.703010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:55.713852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:55.715293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436cac8-3569-451b-a07a-e406655bd6f6 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:55.725405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 713/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:30:58.158293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539678-f7da-4270-ad83-fe8440adabf2 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:58.159164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539678-f7da-4270-ad83-fe8440adabf2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:58.159164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539678-f7da-4270-ad83-fe8440adabf2 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:58.161236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:30:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:30:58.169370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9448-bf41-4ff1-ad53-152a01752cc0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:58.169833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9448-bf41-4ff1-ad53-152a01752cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:58.169938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9448-bf41-4ff1-ad53-152a01752cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:58.189920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-26ef9448-bf41-4ff1-ad53-152a01752cc0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:30:58.191119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26ef9448-bf41-4ff1-ad53-152a01752cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:30:58.200080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:30:58.241618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4539678-f7da-4270-ad83-fe8440adabf2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:30:58.255272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4539678-f7da-4270-ad83-fe8440adabf2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:30:58.260219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:30:58.260868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:30:58.261152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:30:58.261426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:30:58.271931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:30:58.273379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932487-0c4d-48a1-a124-142216f3c0d7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:30:58.283236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 732/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:00.819487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa401-76be-490c-a43a-31831799affc None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:00.820208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa401-76be-490c-a43a-31831799affc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:00.820208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa401-76be-490c-a43a-31831799affc None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:00.821480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:00.827117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189756f-a364-4734-ba27-6a876166df4c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:00.827639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189756f-a364-4734-ba27-6a876166df4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:00.827639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189756f-a364-4734-ba27-6a876166df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:00.847254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8189756f-a364-4734-ba27-6a876166df4c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:00.848509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8189756f-a364-4734-ba27-6a876166df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:00.858668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:00.903270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa401-76be-490c-a43a-31831799affc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:00.906615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0d8fa401-76be-490c-a43a-31831799affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:00.925084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa401-76be-490c-a43a-31831799affc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:00.929946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:00.930471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:00.930816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:00.931090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:00.941442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:00.942909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8fab9-f8ab-4f9e-9fdb-9e908990215f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:00.953409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 716/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:03.316422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4eb51-02dd-4cac-8b16-289f4e35d433 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:03.317343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4eb51-02dd-4cac-8b16-289f4e35d433 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:03.317343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4eb51-02dd-4cac-8b16-289f4e35d433 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:03.319589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:03.326108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8541-1784-404c-8c74-eafa21d7d939 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:03.326865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8541-1784-404c-8c74-eafa21d7d939 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:03.327005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8541-1784-404c-8c74-eafa21d7d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:03.349598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-98db8541-1784-404c-8c74-eafa21d7d939 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:03.350788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-98db8541-1784-404c-8c74-eafa21d7d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:03.359093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:03.397664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4eb51-02dd-4cac-8b16-289f4e35d433 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:03.409770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4eb51-02dd-4cac-8b16-289f4e35d433 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:03.413906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:03.414605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:03.414885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:03.415157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:03.425765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:03.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592268-cedc-415a-a483-b384e0527e91 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:03.437120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 735/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:05.724902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f95b2-ce78-45b4-8669-c078dee52969 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:05.725712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f95b2-ce78-45b4-8669-c078dee52969 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:05.725712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f95b2-ce78-45b4-8669-c078dee52969 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:05.728115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:05.736843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c922-d91f-46e7-9f10-a729668aac6b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:05.737584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c922-d91f-46e7-9f10-a729668aac6b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:05.737757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c922-d91f-46e7-9f10-a729668aac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:05.758416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9339c922-d91f-46e7-9f10-a729668aac6b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:05.759567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9339c922-d91f-46e7-9f10-a729668aac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:05.767985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:05.806771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f95b2-ce78-45b4-8669-c078dee52969 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:05.821901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f95b2-ce78-45b4-8669-c078dee52969 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:05.825848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:05.826559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:05.826844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:05.827123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:05.836911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:05.838349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074accb7-b0d4-4922-8e1e-9f6cd436e93b service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:05.850104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 719/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:08.204223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf116-7724-42da-956b-dc616f811706 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:08.204791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf116-7724-42da-956b-dc616f811706 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:08.204791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf116-7724-42da-956b-dc616f811706 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:08.206950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:08.215767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548298b-76ab-4fd9-81b3-071a62b301d6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:08.216218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548298b-76ab-4fd9-81b3-071a62b301d6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:08.216377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548298b-76ab-4fd9-81b3-071a62b301d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:08.238836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6548298b-76ab-4fd9-81b3-071a62b301d6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:08.240102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6548298b-76ab-4fd9-81b3-071a62b301d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:08.248993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:08.289829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf116-7724-42da-956b-dc616f811706 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:08.302809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf116-7724-42da-956b-dc616f811706 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:08.307282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:08.307960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:08.308249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:08.308526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:08.317791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:08.319242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c324d-0c6c-41b8-9a4c-b7a81a1a4795 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:08.328853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 738/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:10.604464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c370-de5a-444a-9d9f-87ce89d8982e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:10.605363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c370-de5a-444a-9d9f-87ce89d8982e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:10.605363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c370-de5a-444a-9d9f-87ce89d8982e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:10.607561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:10.614257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64e3c3-dbd0-4721-9b07-1876b79e8d25 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:10.614760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64e3c3-dbd0-4721-9b07-1876b79e8d25 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:10.614896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64e3c3-dbd0-4721-9b07-1876b79e8d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:10.641115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2e64e3c3-dbd0-4721-9b07-1876b79e8d25 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:10.642347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e64e3c3-dbd0-4721-9b07-1876b79e8d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:10.650794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:10.691884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c370-de5a-444a-9d9f-87ce89d8982e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:10.705656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c370-de5a-444a-9d9f-87ce89d8982e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:10.710203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:10.710868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:10.711250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:10.711545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:10.721581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:10.723030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075dcd-5617-4ed8-8b17-cf3cbf67f137 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:10.732750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 722/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:13.077670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da8d78-9f6c-4267-8651-54d2ebb609e5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.078228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da8d78-9f6c-4267-8651-54d2ebb609e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.078228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da8d78-9f6c-4267-8651-54d2ebb609e5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.079769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:13.085292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf4f0-5895-4c1d-9309-88d719b0ed46 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.085781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf4f0-5895-4c1d-9309-88d719b0ed46 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.086120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf4f0-5895-4c1d-9309-88d719b0ed46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.104898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2adaf4f0-5895-4c1d-9309-88d719b0ed46 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:13.106090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2adaf4f0-5895-4c1d-9309-88d719b0ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:13.115007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:13.154131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da8d78-9f6c-4267-8651-54d2ebb609e5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.167672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da8d78-9f6c-4267-8651-54d2ebb609e5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.172419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.173064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.173344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.173619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.184083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.185531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb128f3-277d-489f-a98c-0a0e29c7e119 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.195590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 741/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:15.416496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2e00-542b-43f7-aff6-9d91e990f240 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.417154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2e00-542b-43f7-aff6-9d91e990f240 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.417154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a2e00-542b-43f7-aff6-9d91e990f240 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.418445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:31:15.425346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee34d-0837-4c97-9288-3b10a7bfb6ca None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.425819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee34d-0837-4c97-9288-3b10a7bfb6ca None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.425952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ee34d-0837-4c97-9288-3b10a7bfb6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.447589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-893ee34d-0837-4c97-9288-3b10a7bfb6ca None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:15.448828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-893ee34d-0837-4c97-9288-3b10a7bfb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:15.459390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:15.497434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a2e00-542b-43f7-aff6-9d91e990f240 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.511042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a2e00-542b-43f7-aff6-9d91e990f240 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.515959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.516612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.516893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.517167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.527473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.528980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445aa0e3-e58f-4674-b00b-3e00d84de469 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.541516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 725/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:17.790628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bbe1-cc69-4863-b6c5-2af054629de5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.791183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bbe1-cc69-4863-b6c5-2af054629de5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.791183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bbe1-cc69-4863-b6c5-2af054629de5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.792529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:17.799453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461d67-47b2-4293-839a-44abd87bc588 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.799969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461d67-47b2-4293-839a-44abd87bc588 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.800065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461d67-47b2-4293-839a-44abd87bc588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.820595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-24461d67-47b2-4293-839a-44abd87bc588 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:17.821889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-24461d67-47b2-4293-839a-44abd87bc588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:17.830622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:17.867893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5bbe1-cc69-4863-b6c5-2af054629de5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:17.882387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5bbe1-cc69-4863-b6c5-2af054629de5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:17.886777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:17.887422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.887717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.888000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.898723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:17.900197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e74d-14c3-49b8-ab3f-fecbf8c079dd service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:17.909941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 744/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:51.053886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354adf4-a66e-4cda-b8c0-5c8a00cf6438 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:51.054834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354adf4-a66e-4cda-b8c0-5c8a00cf6438 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:51.054834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354adf4-a66e-4cda-b8c0-5c8a00cf6438 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:51.057197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 727/1471] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:31:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:51.062568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060023-ecd0-4007-a83e-2361678661be None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:51.063022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060023-ecd0-4007-a83e-2361678661be None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:51.063127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d060023-ecd0-4007-a83e-2361678661be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:51.084851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9d060023-ecd0-4007-a83e-2361678661be None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:51.086385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9d060023-ecd0-4007-a83e-2361678661be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:51.095338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 745/1472] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:51.143348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b574-6553-46dc-bf91-c920c6baa6f0 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:51.143638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b574-6553-46dc-bf91-c920c6baa6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:51.143952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b574-6553-46dc-bf91-c920c6baa6f0 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:51.145341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 728/1473] 10.222.0.79 () {54 vars in 962 bytes} [Thu May 12 14:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:51.150609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c19f69-c5ea-45bb-a2a3-6b7efedb26cd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:51.150897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c19f69-c5ea-45bb-a2a3-6b7efedb26cd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:51.151173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c19f69-c5ea-45bb-a2a3-6b7efedb26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:51.171212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-39c19f69-c5ea-45bb-a2a3-6b7efedb26cd None None] MFA Rules not processed for user `f11c04b2350b44c6a9dd95acf914fc69`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:51.172479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-39c19f69-c5ea-45bb-a2a3-6b7efedb26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:51.180411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 746/1474] 10.222.0.79 () {58 vars in 1059 bytes} [Thu May 12 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:51.187903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b574-6553-46dc-bf91-c920c6baa6f0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:51.200415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b574-6553-46dc-bf91-c920c6baa6f0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:51.204483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:51.205121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:51.205397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:51.205686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:51.214777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:51.216242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeb630-8507-4e4e-997e-c9646fb94e5a service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:51.225604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 729/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:53.576259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246cc3-5235-4291-8774-3dd986d2e1d0 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:53.577170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246cc3-5235-4291-8774-3dd986d2e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:53.577325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246cc3-5235-4291-8774-3dd986d2e1d0 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:53.579549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 747/1476] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:31:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:53.588273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e92b5-d572-4f63-bd2c-f54fbbd1d50f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:53.589110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e92b5-d572-4f63-bd2c-f54fbbd1d50f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:53.589283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e92b5-d572-4f63-bd2c-f54fbbd1d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:53.618682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0e8e92b5-d572-4f63-bd2c-f54fbbd1d50f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:53.619918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0e8e92b5-d572-4f63-bd2c-f54fbbd1d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:53.628682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 730/1477] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:53.652104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68246cc3-5235-4291-8774-3dd986d2e1d0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:53.666863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68246cc3-5235-4291-8774-3dd986d2e1d0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:53.672501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:53.673160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:53.673440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:53.673725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:53.674461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:53.676299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:53.676299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:31:53.676299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:31:53.677466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1b5c6-e6f7-4542-9b53-cfdf0d5601b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:53.697833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 748/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Thu May 12 14:31:53 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:55.955438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b073a3-9734-4ba7-b9d2-b0ee42b09bd9 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:55.956431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b073a3-9734-4ba7-b9d2-b0ee42b09bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:55.956431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b073a3-9734-4ba7-b9d2-b0ee42b09bd9 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:55.958548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 731/1479] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:31:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:55.964247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcb07-d2b3-4ed3-8ab4-0745304215d8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:55.964666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcb07-d2b3-4ed3-8ab4-0745304215d8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:55.964784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcb07-d2b3-4ed3-8ab4-0745304215d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:55.993616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d84bcb07-d2b3-4ed3-8ab4-0745304215d8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:55.994838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d84bcb07-d2b3-4ed3-8ab4-0745304215d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:56.003978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 749/1480] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:56.056652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b073a3-9734-4ba7-b9d2-b0ee42b09bd9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:56.074786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b073a3-9734-4ba7-b9d2-b0ee42b09bd9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:56.083738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:56.084438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:56.084751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:56.085032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:56.093575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:56.095204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd153a-d915-427e-abe3-71fe65b4b2dc service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:56.104946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 732/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:58.515682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73892c8b-19c5-48d6-913e-02bd1d5617a5 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:58.516317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73892c8b-19c5-48d6-913e-02bd1d5617a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:58.516317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73892c8b-19c5-48d6-913e-02bd1d5617a5 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:58.518263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 750/1482] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:58.523745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4a54-5fb9-4b8d-8ff7-12fabb13b203 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:58.524200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4a54-5fb9-4b8d-8ff7-12fabb13b203 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:58.524379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4a54-5fb9-4b8d-8ff7-12fabb13b203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:58.542213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9b7b4a54-5fb9-4b8d-8ff7-12fabb13b203 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:58.543404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9b7b4a54-5fb9-4b8d-8ff7-12fabb13b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:58.552591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 733/1483] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:58.589362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73892c8b-19c5-48d6-913e-02bd1d5617a5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:58.601432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73892c8b-19c5-48d6-913e-02bd1d5617a5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:58.605740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:58.606399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:58.606681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:58.606957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:58.616360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:58.618296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd33b5c-1792-453e-a80b-c64c4c5ec944 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:58.628443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 751/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:00.914461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f1a4-ce1f-4c07-9353-f55b0d8010a3 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:00.915193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f1a4-ce1f-4c07-9353-f55b0d8010a3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:00.915193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339f1a4-ce1f-4c07-9353-f55b0d8010a3 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:00.916568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 734/1485] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:32:00.923333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241599-e47d-4726-903e-884698d555fb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:00.923823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241599-e47d-4726-903e-884698d555fb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:00.923925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241599-e47d-4726-903e-884698d555fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:00.954210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-be241599-e47d-4726-903e-884698d555fb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:00.955432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-be241599-e47d-4726-903e-884698d555fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:00.964640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 752/1486] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:01.012692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339f1a4-ce1f-4c07-9353-f55b0d8010a3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:01.025996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339f1a4-ce1f-4c07-9353-f55b0d8010a3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:01.030448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:01.031097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:01.031352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:01.031659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:01.041104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:01.042546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2311d-858c-4d66-8f7f-37878cb23556 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:01.052844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 735/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:03.399215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404cf1-be6e-489f-95db-9c3754224ead None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:03.399916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404cf1-be6e-489f-95db-9c3754224ead None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:03.399916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404cf1-be6e-489f-95db-9c3754224ead None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:03.401477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 753/1488] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:32:03.407934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35236c-5702-4d2f-883a-335c6dd54610 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:03.408745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35236c-5702-4d2f-883a-335c6dd54610 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:03.408914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35236c-5702-4d2f-883a-335c6dd54610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:03.430794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9b35236c-5702-4d2f-883a-335c6dd54610 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:03.432050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9b35236c-5702-4d2f-883a-335c6dd54610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:03.440386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 736/1489] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:03.480449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404cf1-be6e-489f-95db-9c3754224ead None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:03.491951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404cf1-be6e-489f-95db-9c3754224ead None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:03.496638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:03.497283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:03.497560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:03.497831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:03.507838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:03.509497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85867-0a73-4d19-acd3-dc44b27e3372 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:03.519276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 754/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:05.953874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9649e-286d-4b96-bef7-60b25503e0b8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:05.954777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9649e-286d-4b96-bef7-60b25503e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:05.954777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9649e-286d-4b96-bef7-60b25503e0b8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:05.957038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 737/1491] 10.222.0.79 () {54 vars in 926 bytes} [Thu May 12 14:32:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:32:05.963384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031520c7-566e-489b-b4d2-df5165d55ade None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:05.963875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031520c7-566e-489b-b4d2-df5165d55ade None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:05.963987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031520c7-566e-489b-b4d2-df5165d55ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:05.988468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-031520c7-566e-489b-b4d2-df5165d55ade None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:05.989688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-031520c7-566e-489b-b4d2-df5165d55ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:05.999331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 755/1492] 10.222.0.79 () {58 vars in 1023 bytes} [Thu May 12 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:06.037726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9649e-286d-4b96-bef7-60b25503e0b8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:06.050929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9649e-286d-4b96-bef7-60b25503e0b8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:06.056078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:06.056815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:06.057097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:06.057372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:06.067111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:06.068623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b683bd-f315-4986-8648-a6022c2309bf service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:06.080483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 738/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:35.379455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.380450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.380450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.400719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:35.401922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:35.412209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 756/1494] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:35.422409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.422930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.422930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.442560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:35.443729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:35.453850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 739/1495] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:35.461286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.472279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99964dc-4fdd-4eda-95b9-5d5036ef7df4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.478650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.479315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.479593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.479892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.480610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:35.480887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.481933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.481933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:33:35.481933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:33:35.482844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.496048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 757/1496] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:35.505112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.519423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de157c95-c24b-45d9-b8c6-50bec71bdb6d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.524892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.525587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.525871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.526143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.526850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.528712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.528712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:33:35.528712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:33:35.529945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.572703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 740/1497] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:35.578812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.589526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265dc14-f845-4d79-836d-c38941cf5513 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.648621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.649218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.649490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.649761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.650452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.651473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.651473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:33:35.651473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:33:35.652704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.680621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 758/1498] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:35.685120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.695862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c5a7-d325-42e8-bffb-eabeca63aa93 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.701229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.701901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.702177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.702442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.703166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.704255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.704255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:33:35.704255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:33:35.705140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.718202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 741/1499] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:35.722608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.733441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34248-e35c-4631-b627-78b16b27235e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.738908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.739572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.739887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.740159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.740886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.742157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.742157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:33:35.742157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:33:35.743037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa26287-8d05-4ce0-ab1c-bf37d6869005 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.756621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 759/1500] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:35.761090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:35.771312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa535a60-5c94-4012-b613-ec5652adb32f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:35.776787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:35.777674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.777953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.778229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] PATH_INFO: `/v3/projects/f08be226c27042e5ad53c8b21bea6247/users/6674fad7b2ef4382ad1040992361c337/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.793262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08be226c27042e5ad53c8b21bea6247, user_id=6674fad7b2ef4382ad1040992361c337, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:35.794306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:35.794306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:33:35.794306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:33:35.796596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaec6b1-2726-45d5-a4cf-f9d17dd9a0aa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:35.813123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 742/1501] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:33:35 2022] PUT /identity/v3/projects/f08be226c27042e5ad53c8b21bea6247/users/6674fad7b2ef4382ad1040992361c337/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:35.824757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433f2a-bd38-4b38-a28e-d6125d6944c5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.825043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433f2a-bd38-4b38-a28e-d6125d6944c5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.825320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433f2a-bd38-4b38-a28e-d6125d6944c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.851489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-49433f2a-bd38-4b38-a28e-d6125d6944c5 None None] MFA Rules not processed for user `6674fad7b2ef4382ad1040992361c337`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:35.852713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-49433f2a-bd38-4b38-a28e-d6125d6944c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:35.918092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 760/1502] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:35.936212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b71bd-b158-43b4-89b6-268d3a0ee0a4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.936503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b71bd-b158-43b4-89b6-268d3a0ee0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.936809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b71bd-b158-43b4-89b6-268d3a0ee0a4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.938267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 743/1503] 10.222.0.79 () {54 vars in 963 bytes} [Thu May 12 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:33:35.943347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e864-f522-4fa6-b5fa-a782230cd864 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:35.943630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e864-f522-4fa6-b5fa-a782230cd864 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:35.943946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e864-f522-4fa6-b5fa-a782230cd864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:35.963391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8eb6e864-f522-4fa6-b5fa-a782230cd864 None None] MFA Rules not processed for user `acb6ff788d5841a3b627c60feaf44d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:35.964594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8eb6e864-f522-4fa6-b5fa-a782230cd864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:36.014994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 761/1504] 10.222.0.79 () {58 vars in 1060 bytes} [Thu May 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:36.023914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b71bd-b158-43b4-89b6-268d3a0ee0a4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:36.035449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b71bd-b158-43b4-89b6-268d3a0ee0a4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:36.039806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:36.040450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.040759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.041033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.049840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:36.051269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:36.060215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 744/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:33:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:36.106320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1df0-c2dc-47ce-8011-0eed47b1460a None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.106612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1df0-c2dc-47ce-8011-0eed47b1460a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.106890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e1df0-c2dc-47ce-8011-0eed47b1460a None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.108238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 762/1506] 10.222.0.79 () {52 vars in 829 bytes} [Thu May 12 14:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:33:36.112009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:36.175297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10450f6-e82c-48ed-b890-eda2b6bb91a9 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:36.180718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:36.181600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.181855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.182119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] PATH_INFO: `/v3/users/6674fad7b2ef4382ad1040992361c337` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.183416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6674fad7b2ef4382ad1040992361c337)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:36.184483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:36.184483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:33:36.184483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:33:36.185685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:36.254372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6674fad7b2ef4382ad1040992361c337'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.272073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6674fad7b2ef4382ad1040992361c337'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.272782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6674fad7b2ef4382ad1040992361c337'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.273683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6674fad7b2ef4382ad1040992361c337'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.288376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6674fad7b2ef4382ad1040992361c337'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.307744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 745/1507] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:33:36 2022] DELETE /identity/v3/users/6674fad7b2ef4382ad1040992361c337 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:36.312480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.312796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.313076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.330853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:36.332091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:36.399463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 763/1508] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:36.412822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:36.415073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:36.477585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb527e-ac69-437e-9e14-2322ea464e2e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:36.481981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:36.482647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.482929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.483205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.494555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:36.496073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b516-bb91-443c-871b-df8e0ccfc94f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:36.507559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 746/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:36.886089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:36.887636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:36.900806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18d0fe-c48f-4bfc-b2d0-20c007717068 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:36.906087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:36.907032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:36.907311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:36.907583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] PATH_INFO: `/v3/projects/f08be226c27042e5ad53c8b21bea6247` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:36.908812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08be226c27042e5ad53c8b21bea6247)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:36.909899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:33:36.909899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:33:36.909899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:33:36.911084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:36.975726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08be226c27042e5ad53c8b21bea6247', 'request_id': 'req-257535bc-a9b9-4292-89da-a4f655f82e8b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.982448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08be226c27042e5ad53c8b21bea6247', 'request_id': 'req-257535bc-a9b9-4292-89da-a4f655f82e8b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:36.993477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08be226c27042e5ad53c8b21bea6247', 'request_id': 'req-257535bc-a9b9-4292-89da-a4f655f82e8b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:37.013119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] The token cache is being invalidate because project f08be226c27042e5ad53c8b21bea6247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:37.013342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:37.013967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-257535bc-a9b9-4292-89da-a4f655f82e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:37.015656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 764/1510] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:33:36 2022] DELETE /identity/v3/projects/f08be226c27042e5ad53c8b21bea6247 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:35:25.141984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:25.142988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:25.142988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:25.144760 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:35:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:25.149730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87156-2117-4e98-a32d-cd6f68c4279f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:25.150191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87156-2117-4e98-a32d-cd6f68c4279f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:25.150298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87156-2117-4e98-a32d-cd6f68c4279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:25.174304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f7c87156-2117-4e98-a32d-cd6f68c4279f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:25.175706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f7c87156-2117-4e98-a32d-cd6f68c4279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:25.238131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:25.406261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:25.408293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:25.485109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767780af-0d64-4564-940f-1a77f8300fc6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:25.492644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:25.493317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:25.493596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:25.493871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:25.503176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:25.505192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0871-6408-4e61-bdc1-db984bf0d0f4 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:25.515101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 748/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:26.462749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffaddc-e8e0-4c08-bf6f-5b0a8beef5aa None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:26.463672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffaddc-e8e0-4c08-bf6f-5b0a8beef5aa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:26.463672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffaddc-e8e0-4c08-bf6f-5b0a8beef5aa None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:26.465866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:26.473388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f788e87-51f6-47f1-91e1-06f4fdab35e1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:26.473860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f788e87-51f6-47f1-91e1-06f4fdab35e1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:26.473966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f788e87-51f6-47f1-91e1-06f4fdab35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:26.492329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3f788e87-51f6-47f1-91e1-06f4fdab35e1 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:26.493527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3f788e87-51f6-47f1-91e1-06f4fdab35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:26.501744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:26.655513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffaddc-e8e0-4c08-bf6f-5b0a8beef5aa None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:26.680549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffaddc-e8e0-4c08-bf6f-5b0a8beef5aa None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:26.687914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:26.688565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:26.688851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:26.689139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:26.698745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:26.700409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bc727-66ea-4125-8865-6d3fe105148d service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:26.710313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 767/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:27.177014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3447b6-8265-46c6-a895-a7af8e1e0d02 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:27.177308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3447b6-8265-46c6-a895-a7af8e1e0d02 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:27.177622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3447b6-8265-46c6-a895-a7af8e1e0d02 None None] PATH_INFO: `/v3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:27.178975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 750/1517] 10.222.0.85 () {54 vars in 925 bytes} [Thu May 12 14:35:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:35:27.186524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833786-4148-4720-a94f-1ec1a9009206 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:27.186791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833786-4148-4720-a94f-1ec1a9009206 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:27.187071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833786-4148-4720-a94f-1ec1a9009206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:27.206713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-41833786-4148-4720-a94f-1ec1a9009206 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:27.207933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-41833786-4148-4720-a94f-1ec1a9009206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:27.276091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 768/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Thu May 12 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:37.338274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec1e-2f7d-435c-9cea-3cbc2ac2dfc4 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:37.338947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec1e-2f7d-435c-9cea-3cbc2ac2dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:37.338947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eec1e-2f7d-435c-9cea-3cbc2ac2dfc4 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:37.340234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 751/1519] 10.222.0.79 () {54 vars in 960 bytes} [Thu May 12 14:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:37.345368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c48bd-3b7d-4c40-9e28-68e65c089f95 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:37.345842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c48bd-3b7d-4c40-9e28-68e65c089f95 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:37.345936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c48bd-3b7d-4c40-9e28-68e65c089f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:37.365281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-203c48bd-3b7d-4c40-9e28-68e65c089f95 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:37.366481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-203c48bd-3b7d-4c40-9e28-68e65c089f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:37.376387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 769/1520] 10.222.0.79 () {58 vars in 1057 bytes} [Thu May 12 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:37.384213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eec1e-2f7d-435c-9cea-3cbc2ac2dfc4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:37.399053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eec1e-2f7d-435c-9cea-3cbc2ac2dfc4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:37.404434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:37.405088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:37.405367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:37.405775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:37.414461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:37.416282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5743be-8ccb-411e-87ed-ba2e258f5e69 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:37.426352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 752/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:38.063089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003f84-e058-4cde-9fe1-853e06ffd374 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:38.063494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003f84-e058-4cde-9fe1-853e06ffd374 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:38.063972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003f84-e058-4cde-9fe1-853e06ffd374 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:38.066227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:35:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:38.074238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a454-2e9e-40d3-8edc-a5e885d0bbff None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:38.074525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a454-2e9e-40d3-8edc-a5e885d0bbff None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:38.074791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a454-2e9e-40d3-8edc-a5e885d0bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:38.093993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7056a454-2e9e-40d3-8edc-a5e885d0bbff None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:38.095212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7056a454-2e9e-40d3-8edc-a5e885d0bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:38.104355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:35:38.255735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003f84-e058-4cde-9fe1-853e06ffd374 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:38.274932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003f84-e058-4cde-9fe1-853e06ffd374 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:38.280776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:38.281433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:38.281717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:38.281995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:38.290519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:38.292238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5cb4a-9de7-46ef-8863-cbed0d13af73 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:38.301923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 771/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:39.199209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f8c3-ace7-4d40-9c9a-d606c06777e7 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:39.199841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f8c3-ace7-4d40-9c9a-d606c06777e7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:39.199841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f8c3-ace7-4d40-9c9a-d606c06777e7 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:39.201190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:39.207179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f47fd-127e-4a46-8e3f-f16cb137c7de None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:39.207965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f47fd-127e-4a46-8e3f-f16cb137c7de None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:39.208146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f47fd-127e-4a46-8e3f-f16cb137c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:39.234032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3e3f47fd-127e-4a46-8e3f-f16cb137c7de None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:39.235220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3e3f47fd-127e-4a46-8e3f-f16cb137c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:39.246334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:39.406193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06f8c3-ace7-4d40-9c9a-d606c06777e7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:39.422989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06f8c3-ace7-4d40-9c9a-d606c06777e7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:39.429289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:39.429936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:39.430218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:39.430480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:39.440135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:39.441817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38990e84-e4a9-42dc-acc5-779d553779da service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:39.452031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 755/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:35:43.541364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:43.542316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:43.542316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:43.544537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:43.550261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c61a-433a-4856-92e4-60aa45c20159 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:43.550694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c61a-433a-4856-92e4-60aa45c20159 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:43.550813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c61a-433a-4856-92e4-60aa45c20159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:43.571933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e6d6c61a-433a-4856-92e4-60aa45c20159 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:43.573119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e6d6c61a-433a-4856-92e4-60aa45c20159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:43.581382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:43.618481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:43.620837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:43.681681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e327c-2fc0-4628-99b4-794cd9a43a32 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:43.685994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:43.686638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:43.686912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:43.687252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:43.697071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:43.698485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0913-cf35-4898-aec3-314f15095ebb service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:43.707915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 774/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:45.883298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92ee8d-0211-4278-8956-0041d6f8f1f0 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:45.883893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92ee8d-0211-4278-8956-0041d6f8f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:45.883893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92ee8d-0211-4278-8956-0041d6f8f1f0 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:45.885155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:45.891352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d4cb-33eb-4b86-9e23-d447d6139ca0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:45.892119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d4cb-33eb-4b86-9e23-d447d6139ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:45.892273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d4cb-33eb-4b86-9e23-d447d6139ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:45.911438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fd96d4cb-33eb-4b86-9e23-d447d6139ca0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:45.912654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fd96d4cb-33eb-4b86-9e23-d447d6139ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:45.922221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:45.957707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92ee8d-0211-4278-8956-0041d6f8f1f0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:45.970208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92ee8d-0211-4278-8956-0041d6f8f1f0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:45.974607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:45.975224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:45.975497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:45.975755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:45.990949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:45.993589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a64f5e-f5e5-43c6-92b8-b7f5905d5cef service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:46.008195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 758/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:49.905333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:49.905931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:49.906035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:49.908101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:49.915196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781b85-972f-4a0a-83aa-ce77485f95d7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:49.915721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781b85-972f-4a0a-83aa-ce77485f95d7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:49.915721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781b85-972f-4a0a-83aa-ce77485f95d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:49.940949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9e781b85-972f-4a0a-83aa-ce77485f95d7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:49.942193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9e781b85-972f-4a0a-83aa-ce77485f95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:49.952133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:50.232214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:50.234215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:50.299634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe486d31-492c-4d84-80f5-0e07ab65e9b4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:50.304035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:50.304703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:50.304990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:50.305271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:50.322702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:50.324204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92639e53-defa-4e20-818c-5ea465c57cd7 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:50.335934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 777/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:52.637491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:52.638115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:52.638115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:52.639990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:35:52.647648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed508-8bbf-45ff-a2a8-1ea9d4a624f5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:52.648156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed508-8bbf-45ff-a2a8-1ea9d4a624f5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:52.648256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed508-8bbf-45ff-a2a8-1ea9d4a624f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:52.669799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6e7ed508-8bbf-45ff-a2a8-1ea9d4a624f5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:52.671361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6e7ed508-8bbf-45ff-a2a8-1ea9d4a624f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:52.680002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:52.954618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:52.957853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:52.974248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff0db7-b13f-4986-90f4-32b4cfe3de1b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:52.978326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:52.978976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:52.979252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:52.979520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:52.988497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:52.989934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe4c3-8398-4834-b121-3b2795f07941 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:52.999386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 761/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:24.773801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:24.774980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:24.775484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:24.808292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:24.809958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:24.828359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 779/1540] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:24.842402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:24.843061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:24.843773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:24.893127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:24.895516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:24.916366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 762/1541] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:24.921906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:24.936290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583435e8-7e68-4cbc-a26f-d30a25a6c8cd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:24.943371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:24.944476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:24.944975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:24.945469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:24.946411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:24.946935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:24.948860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:24.966686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 780/1542] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:24.976016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:24.991205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1f2db-dc34-416a-9ea4-bcb3eb679cba None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.001087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.001785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.002064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.002338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.003043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.005237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532db3f-daf9-4a70-b17d-113b37c519ef admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.048203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 763/1543] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:24 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.053169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.066685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099978-48b0-45c5-8f2e-e094bdf8c999 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.071963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a741-c087-4d02-9618-6fc3552c187a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.072283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a741-c087-4d02-9618-6fc3552c187a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.072523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a741-c087-4d02-9618-6fc3552c187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.099810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-10e2a741-c087-4d02-9618-6fc3552c187a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.101089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10e2a741-c087-4d02-9618-6fc3552c187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.144054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.144920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.145457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.145884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.146630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.148997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2045-5335-47e2-a073-4de9e53f7725 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.169892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 764/1544] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.171754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684f4a-09bb-449f-a444-1e71472cd66c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.172207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684f4a-09bb-449f-a444-1e71472cd66c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.172492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684f4a-09bb-449f-a444-1e71472cd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.174568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 781/1545] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:37:25.176720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4c39-dfb7-4eb7-a3a8-7cce39c87a4c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.177159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4c39-dfb7-4eb7-a3a8-7cce39c87a4c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.177435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4c39-dfb7-4eb7-a3a8-7cce39c87a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.194395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5b684f4a-09bb-449f-a444-1e71472cd66c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.194395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5b684f4a-09bb-449f-a444-1e71472cd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.202321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ec8a4c39-dfb7-4eb7-a3a8-7cce39c87a4c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.203625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ec8a4c39-dfb7-4eb7-a3a8-7cce39c87a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.205386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 765/1546] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.207510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.208012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.208445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.213209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 782/1547] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.214769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f20ea-55d7-4f85-8b8d-11b3c4c985cc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.215062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f20ea-55d7-4f85-8b8d-11b3c4c985cc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.219956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f20ea-55d7-4f85-8b8d-11b3c4c985cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.240078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.241305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.247839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9d1f20ea-55d7-4f85-8b8d-11b3c4c985cc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.249111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9d1f20ea-55d7-4f85-8b8d-11b3c4c985cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.250478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 766/1548] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.251619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.261245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 783/1549] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.262923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e5799-b7fc-4847-ac85-378a849252ac None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.263176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e5799-b7fc-4847-ac85-378a849252ac None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.263473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e5799-b7fc-4847-ac85-378a849252ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.273334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e350e-ff85-46ae-94bc-e996070ef95f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.278463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.279169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.279459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.279752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.280498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.282128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7ecf-8311-49bc-bf9b-90bfa0af5b97 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.289672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f81e5799-b7fc-4847-ac85-378a849252ac None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.290896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f81e5799-b7fc-4847-ac85-378a849252ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.293659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 767/1550] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:25.295466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdde4-ca4b-43d6-a4ad-2236bfca786f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.295785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdde4-ca4b-43d6-a4ad-2236bfca786f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.296133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdde4-ca4b-43d6-a4ad-2236bfca786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.301013 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 784/1551] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.302292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8391-7358-4029-9322-09ce347b7e8d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.302597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8391-7358-4029-9322-09ce347b7e8d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.302809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8391-7358-4029-9322-09ce347b7e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.316363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-903fdde4-ca4b-43d6-a4ad-2236bfca786f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.318278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-903fdde4-ca4b-43d6-a4ad-2236bfca786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.320625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1b9b8391-7358-4029-9322-09ce347b7e8d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.321758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1b9b8391-7358-4029-9322-09ce347b7e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.326351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 768/1552] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.327834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3605f-dfef-4000-a09a-fa18f50c15b3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.328081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3605f-dfef-4000-a09a-fa18f50c15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.328425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3605f-dfef-4000-a09a-fa18f50c15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.330478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 785/1553] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.333237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350f2f-f81d-4bb1-889c-ae686c705178 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.333624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350f2f-f81d-4bb1-889c-ae686c705178 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.334199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350f2f-f81d-4bb1-889c-ae686c705178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.346958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-afb3605f-dfef-4000-a09a-fa18f50c15b3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.348196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-afb3605f-dfef-4000-a09a-fa18f50c15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.353011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c350f2f-f81d-4bb1-889c-ae686c705178 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.354172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c350f2f-f81d-4bb1-889c-ae686c705178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.357047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 769/1554] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.358373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.358665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.358936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.362821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 786/1555] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.364829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.365242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.365624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.376868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.378051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.383705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.384876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.385911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 770/1556] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.386698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.396131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bba1dd-e51f-4264-abd2-d90809d517ed None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.397265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 787/1557] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.397265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.402048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.402748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.403050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.403295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.404033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.405960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.409057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115499-db01-4a44-82ad-2d2abe7c06ba None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.414342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.415012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.415298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.415577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.416338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.416589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 771/1558] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:25.419742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.419833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.419938 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.427231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48e17-446d-4f7b-9056-c8d685546730 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.430805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 788/1559] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.431643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.435897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.436775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.437061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.437351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.438202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.438665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.439735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:25.439735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:37:25.439735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:37:25.440635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.441041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dcd0d-db39-4e6e-b652-983bf53a0431 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.445903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.446560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.446847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.447124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.447879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.448189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.449887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ada7c-2a87-48f7-9a3a-e61de317ee7c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.453307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 772/1560] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.454180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.465653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 789/1561] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.465653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ed-d86e-4f33-91e2-18b899eca27f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.465653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ed-d86e-4f33-91e2-18b899eca27f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.465653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ed-d86e-4f33-91e2-18b899eca27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.468395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762bc2-755f-4c5a-9032-ed9e02611e9f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.473158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.474621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.474909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.475196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.475961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.476271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.477924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.485843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c03213ed-d86e-4f33-91e2-18b899eca27f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.487082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c03213ed-d86e-4f33-91e2-18b899eca27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.489902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 773/1562] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.490839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.500366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d519b-8bd8-442c-822d-9f6eb96492c4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.501635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 790/1563] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.503148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.503437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.503673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.506169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.506877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.507143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.507437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.508211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.508524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.510175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.522060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.522526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 774/1564] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.523258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.523362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.531374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 791/1565] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.532014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.532747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35a57-0fac-429d-bbd7-ccfbd787ac04 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.537657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.538539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.538829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.539109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] PATH_INFO: `/v3/projects/2580eb79c9684c318adbfaa325e7f12c/users/99075fda1c7d4e7698e2062407bc2433/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.541818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9bbe6-df1c-4c33-94c7-0a9745f19174 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.546840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.547495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.547816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.548096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.548823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.549861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:25.549861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:37:25.549861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:37:25.551105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.555586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2580eb79c9684c318adbfaa325e7f12c, user_id=99075fda1c7d4e7698e2062407bc2433, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.558306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.573761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 775/1566] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:25 2022] PUT /identity/v3/projects/2580eb79c9684c318adbfaa325e7f12c/users/99075fda1c7d4e7698e2062407bc2433/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:25.574589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.579874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 792/1567] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.581183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.635658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c11c7-12c0-4e3b-9f8e-792aebc1b557 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.640334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.641007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.641287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.641561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.642254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.643620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32b64-9b17-4784-8ecb-77f7f77dbf5a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.644242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.648937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.649607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.649867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.650144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.650842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.652807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.677107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 776/1568] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.677107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.684292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 793/1569] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.684292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.734761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc715ce-c9fa-49b5-bf5e-27a63b93d70e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.740017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda88f07-cf51-43f0-85ae-ff444df63680 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.740664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.741376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.741655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.741924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.742618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.744659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.745139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.745876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.746160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.746436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.747165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.747474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.749123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.760302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 794/1570] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.761254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.771018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214a17-5d64-49b0-a240-e86fccce0f84 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.775509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.776189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.776471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.776744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.777490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.779417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 777/1571] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.779546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8ca34-690a-45d2-839b-9e1c317260e2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.780423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.808485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 795/1572] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.809911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.810324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.810607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.828857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:25.830039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:25.851461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ecd-7b80-49a5-ab3f-7e50f0b5bb8f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.890094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 796/1573] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:25.890764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.902890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369b4da-3f65-4edd-b70d-fdae6d1b4b2c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.906413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.907100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.907383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.907539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.907652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.908259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.908418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:25.908524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.908711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.908816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.909463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.910341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.911719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.922021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 778/1574] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:25.924705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.933729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 797/1575] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.934389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.935121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f312e8-96a8-4aef-8693-31aadb650427 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.940212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.940965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.941250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.941518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.942298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.943328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:25.943328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:37:25.943328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:37:25.944149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f074-cc2b-41fb-9f4a-055722acb2ab admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.944551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.948644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.949300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.949582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.949862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.950543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.952467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.967045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 779/1576] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.971204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.972668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 798/1577] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:25.973522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:25.981697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3edf84-d92d-4280-9e91-0b1a40337828 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.983717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26ea6-bf05-415e-8c35-fb35b6e81229 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:25.986880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.987772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.988240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.988439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:25.988569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.989326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.989790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:25.990828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:25.991419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:25.992024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:25.992732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:25.994637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.015816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 799/1578] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.016864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.021879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 780/1579] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.022727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.029118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234563d-c6e4-4bb6-8466-099b4d0f5639 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.076419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a070d-2b59-4e88-b380-bc137000da2a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.079999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.080658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.080938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.081200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.087032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.087912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.088236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.088515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.089214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.091263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.111917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 800/1580] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.113071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.122702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8aec-77e5-4bda-ac56-797fbe83fbf8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.128020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.128695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.128955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.129223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.130078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.132311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.142754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.144243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.154353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 781/1581] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:26.155202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.159382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 801/1582] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.163601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.166522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ea1e6-8be9-4651-b4b1-e6d50f18b73c service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.229592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.230372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.230677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.230951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.231717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.233406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.234338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9098a8-f73f-4efa-8c4c-bfa65f1d98a3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.239968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.240800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.241167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.241594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.242449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.244321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.244460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 782/1583] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.248312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.257951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 802/1584] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.258809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.260543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bb42a-a43e-486a-8f90-f58ca8d22558 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.267649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.268691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.268816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db629847-257f-452f-848a-0908764f88a3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.269382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.269879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.271790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.274289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.274628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.275369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.275863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.276110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.276912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.278599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.286798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 783/1585] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.287899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.297658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 803/1586] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.298693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.300923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91983b0-9ea9-43ed-90f1-5234923f1a52 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.306560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.307262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.307544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.307903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.308613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.308873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448162-320e-4eff-a674-fc7854d1aed0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.310580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.313620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.314292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.314571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.314846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.315571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.317477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.330381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 804/1587] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.331283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.342894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 784/1588] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.342894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.343207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e5c-5582-4c71-8e60-15fdae97c021 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.347661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.348520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.348958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.349661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.350147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.352186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.353327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54346-8478-415c-bd65-108d1b31adb8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.358233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.358996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.359327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.359672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.360500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.362226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.384464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 805/1589] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:26.384464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.385033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 785/1590] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.385033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.391195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a830c-53c8-4b82-a0c1-4b545f16b2d4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.396153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e31ac-1a30-415c-b7a6-2bf157d83103 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.397084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.397860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.398213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.398693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.399601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.401355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.402476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.403274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.404362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.404362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.405045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.407038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.417877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 806/1591] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.417877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.428990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 786/1592] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.428990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.429433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e168b-e65e-4e3d-9f31-e5d43646d5db admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.435185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.436460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.438457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.438457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.439154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.440830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.442244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c1f4-1941-4041-b50f-836406424ff2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.450074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.450074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.450074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.450424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.451130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.453017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.454744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 807/1593] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.456320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.471108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b4b00-67d3-40d8-bb03-6cb107dafdc7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.475913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 787/1594] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.475913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.480418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.480675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.481027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.481298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.482030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.483656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.484800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7f77-e62d-4235-8f3a-334d93e41af7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.490275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.491128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.491654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.492053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.492866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.495047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.495535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 808/1595] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.496466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.508556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065fc5d-5114-4ba7-9279-b1d3908cc720 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.513150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 788/1596] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.513415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.514164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.514446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.515433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.515433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] PATH_INFO: `/v3/projects/4bfc0cf739ef49329b3abc976a5cf1ab/users/8d318a968c834567a30e9788e752cdc6/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.524783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278607f-09c3-4326-9491-dde42a40fc29 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.530058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.531312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.531582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.532064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] PATH_INFO: `/v3/projects/c865b8a441ac423e9032a0c70301ec6e/users/6f801c74ab294ea98c631aa74aed8f07/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.537760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc0cf739ef49329b3abc976a5cf1ab, user_id=8d318a968c834567a30e9788e752cdc6, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.538934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:26.538934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:37:26.538934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:37:26.541308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.557211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 809/1597] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:26 2022] PUT /identity/v3/projects/4bfc0cf739ef49329b3abc976a5cf1ab/users/8d318a968c834567a30e9788e752cdc6/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:26.558873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.572114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c865b8a441ac423e9032a0c70301ec6e, user_id=6f801c74ab294ea98c631aa74aed8f07, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.577428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.595336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 789/1598] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:26 2022] PUT /identity/v3/projects/c865b8a441ac423e9032a0c70301ec6e/users/6f801c74ab294ea98c631aa74aed8f07/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:26.596888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.623543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73449-a723-4043-be14-bf75f1b0bc1a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.680607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd518e7-d96b-4eec-9fcd-dcbbe18687d7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.684876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.685274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.686051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.686181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.686441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.686562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.686724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] PATH_INFO: `/v3/projects/a19bebfab4b04002b724c33fed885456/users/0b5ed933ce4a4f5ea7bb99f3e4bca8e1/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.687111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] PATH_INFO: `/v3/projects/978ae8df74584181a38220fae537c6dc/users/4f8a6e0d6f164c64ab7f898bab4e6f9c/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.702405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19bebfab4b04002b724c33fed885456, user_id=0b5ed933ce4a4f5ea7bb99f3e4bca8e1, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.702879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978ae8df74584181a38220fae537c6dc, user_id=4f8a6e0d6f164c64ab7f898bab4e6f9c, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.705146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.705774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.720703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 790/1599] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:26 2022] PUT /identity/v3/projects/a19bebfab4b04002b724c33fed885456/users/0b5ed933ce4a4f5ea7bb99f3e4bca8e1/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:26.721607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 810/1600] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:26 2022] PUT /identity/v3/projects/978ae8df74584181a38220fae537c6dc/users/4f8a6e0d6f164c64ab7f898bab4e6f9c/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:26.722198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.722603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.800637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4350-85ca-44c4-bfa4-b03dc7ce70c4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.801694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bddcc5-504e-46d3-b127-45e0992fb068 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.806904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.808010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.808489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.808733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.809016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.809221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.809332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.809753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] PATH_INFO: `/v3/projects/9794155ca0aa4b75a153f0640e068ff5/users/ab522f0209154f959a431caa01f3a029/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.810071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.811784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.830518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 811/1601] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.830518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:26.831956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9794155ca0aa4b75a153f0640e068ff5, user_id=ab522f0209154f959a431caa01f3a029, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.837554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf36e2-2ed7-4a6f-b58d-ee8c6a6d5261 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.845955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c740126-bd76-4256-a1ef-8df0fc9a51c6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:26.853866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 791/1602] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:26 2022] PUT /identity/v3/projects/9794155ca0aa4b75a153f0640e068ff5/users/ab522f0209154f959a431caa01f3a029/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:26.855012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1cbfe-479b-4ce6-889d-7aa43764fc7a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.855403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1cbfe-479b-4ce6-889d-7aa43764fc7a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.855779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1cbfe-479b-4ce6-889d-7aa43764fc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.875399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-07b1cbfe-479b-4ce6-889d-7aa43764fc7a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:26.876753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-07b1cbfe-479b-4ce6-889d-7aa43764fc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:26.908121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:26.908832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.909197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.909505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.910218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:26.913066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1152d31-b189-4df6-9155-c32a10cbd797 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:26.923227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 812/1603] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:26.924705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9051-08b9-42d6-95c1-f2f08d228c4a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.924993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9051-08b9-42d6-95c1-f2f08d228c4a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.925274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd9051-08b9-42d6-95c1-f2f08d228c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.946897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-69bd9051-08b9-42d6-95c1-f2f08d228c4a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:26.949020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-69bd9051-08b9-42d6-95c1-f2f08d228c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:26.954429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 792/1604] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:26.956029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.956299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.956569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.974946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 813/1605] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:26.974946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68bf8c-3bf9-4994-aa60-a59746a17244 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:26.980633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68bf8c-3bf9-4994-aa60-a59746a17244 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:26.980993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68bf8c-3bf9-4994-aa60-a59746a17244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:26.997703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] MFA Rules not processed for user `0b5ed933ce4a4f5ea7bb99f3e4bca8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:26.998606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.014758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-aa68bf8c-3bf9-4994-aa60-a59746a17244 None None] MFA Rules not processed for user `4f8a6e0d6f164c64ab7f898bab4e6f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:27.016147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa68bf8c-3bf9-4994-aa60-a59746a17244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.072399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 793/1606] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:27.073323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.083950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9529685-e0f1-4b98-bc19-846c69d2b2da None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.088761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.089675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.089953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.090224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] PATH_INFO: `/v3/projects/16f5ef2fef0e45ffa7bb70f56141e6b3/users/7a2da6951ae64b9d93715154b3c605ba/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.099449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 814/1607] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:27.100940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.101233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.101508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.111921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f5ef2fef0e45ffa7bb70f56141e6b3, user_id=7a2da6951ae64b9d93715154b3c605ba, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.115823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.123025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:27.124646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.133636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 794/1608] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:27 2022] PUT /identity/v3/projects/16f5ef2fef0e45ffa7bb70f56141e6b3/users/7a2da6951ae64b9d93715154b3c605ba/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:27.134834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.199471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 815/1609] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:27.200681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.202409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.216142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ab38-bab0-42a9-ab86-f3b0b0d10226 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.221493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.222645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.223368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.224051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] PATH_INFO: `/v3/projects/0dd7bf482a7c472bbe4857f2d71d00e1/users/f7b41d1655e24cf0b1f4bda137115af4/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.243535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd7bf482a7c472bbe4857f2d71d00e1, user_id=f7b41d1655e24cf0b1f4bda137115af4, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.247496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.264043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 795/1610] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:27 2022] PUT /identity/v3/projects/0dd7bf482a7c472bbe4857f2d71d00e1/users/f7b41d1655e24cf0b1f4bda137115af4/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:27.265210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.270699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7ca3-20b7-4409-9b4c-76bbd95d3941 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.330652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa5bd8-943a-4038-8fd3-b74af10e9c85 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.335132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.336441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.336905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.337334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.338214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.339128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.339420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.339849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.405687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.407523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.418484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 796/1611] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:27.419678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.431112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80fcd6-7cdc-4f91-9aa7-072e8972e1f0 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.434245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.435976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.437337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.438429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.438856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.439291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.440177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.442645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0b5aa-9da4-4fd8-b105-52b86960c7e6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.457854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 816/1612] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:27.458978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.471608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4716-6d75-453a-a2a5-0013898d7f8a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.477801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.478666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.479041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.480426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.481368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.483934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.487530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 797/1613] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:27.493655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ecf5-84c9-4886-8306-8d2038c9e510 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.493655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ecf5-84c9-4886-8306-8d2038c9e510 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.493655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ecf5-84c9-4886-8306-8d2038c9e510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.544844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 817/1614] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:27.547346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.554854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7ca0ecf5-84c9-4886-8306-8d2038c9e510 None None] MFA Rules not processed for user `7a2da6951ae64b9d93715154b3c605ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:27.556407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7ca0ecf5-84c9-4886-8306-8d2038c9e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.671056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ecbab-c865-4f06-ab40-74b0abfd63a8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.676554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 798/1615] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:27.676554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.676554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.676554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.686087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.686980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.687442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.687859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.706734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:27.709772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:27.835497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 799/1616] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:27.837329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.839080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.840521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.859073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582a133-755c-48b1-8726-51d5c66b2938 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.865451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 818/1617] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:27.869279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.876161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.877250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.877757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.878574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.879759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.881449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf8e6-af10-4294-b6ad-95f0ca37ede9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.885497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3c9b-030d-4c4b-9a29-e0f3a52bf7cb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.895836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.896626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.896915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.897194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.897962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.900375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.946702 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 800/1618] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:27.948271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987767-4d57-421f-9bc6-9545dcf514bc None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.948568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987767-4d57-421f-9bc6-9545dcf514bc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.948850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987767-4d57-421f-9bc6-9545dcf514bc None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.950373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 801/1619] 10.222.0.79 () {54 vars in 961 bytes} [Thu May 12 14:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:27.951105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1987767-4d57-421f-9bc6-9545dcf514bc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.958004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 819/1620] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:27 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:27.958969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:27.970746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db05c3-ccd2-4b0d-9eed-5946d66fc3f1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.977201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.978388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.978511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1987767-4d57-421f-9bc6-9545dcf514bc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:27.978679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.978973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:27.980112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:27.982349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:27.983105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:27.983228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c39d54-0af8-45a4-9fbe-43a447f58ba3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:27.983328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:27.983554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.004297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 820/1621] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:28.006095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.006389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.006672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.007464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.008989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.032929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 802/1622] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:28.033805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.044682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:28.047415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:28.054058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04cbad-7b76-482f-b713-b582e1ad8d87 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.065825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.066531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.066821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.067141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.068452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.070110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.089022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 803/1623] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:28.091119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.124473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e000f-6773-48d0-a77b-c6297b868f18 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.161519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.162781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.163157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.163517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] PATH_INFO: `/v3/projects/3cf2da5e017b40618f8f60b176afaf23/users/ccf07913000644c2af16e3425cf63c65/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.204463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2da5e017b40618f8f60b176afaf23, user_id=ccf07913000644c2af16e3425cf63c65, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.217988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.247849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 821/1624] 10.222.0.79 () {58 vars in 1058 bytes} [Thu May 12 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:28.248421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.263975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 804/1625] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:28 2022] PUT /identity/v3/projects/3cf2da5e017b40618f8f60b176afaf23/users/ccf07913000644c2af16e3425cf63c65/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:28.267351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.268871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a922-3fd3-4312-9c3d-908b9b8336be None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.363598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.365332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.365615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.365892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] PATH_INFO: `/v3/projects/92ced65f907046849d94c3397ddd947a/users/a6d59c4ab50d4c71aa97bc55a87b81b6/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.403767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ced65f907046849d94c3397ddd947a, user_id=a6d59c4ab50d4c71aa97bc55a87b81b6, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.407253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.409887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f789-f2db-4f7a-b9d4-2a4032e2c794 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.421602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.422407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.425803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.426113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.434914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 822/1626] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:28 2022] PUT /identity/v3/projects/92ced65f907046849d94c3397ddd947a/users/a6d59c4ab50d4c71aa97bc55a87b81b6/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:28.436488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.528342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.530179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.546217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 805/1627] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:28.562480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.570149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737e15-a3f5-413e-a129-77760f66fcd1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.584073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.585280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.586029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.586361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.593148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.597180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.605764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ebc3-b9f3-429e-8930-fe8f39dcd4fd service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.619414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.620719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.621031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.625168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.626689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.632825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 823/1628] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:28.633036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.633967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.656932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c386722-12d1-44ad-b563-3417ec1b91ae admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.658292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 806/1629] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:28.662280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:28.676591 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.682154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.682154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.682154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] PATH_INFO: `/v3/projects/3cf2da5e017b40618f8f60b176afaf23/users/ccf07913000644c2af16e3425cf63c65/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.687649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2da5e017b40618f8f60b176afaf23, user_id=ccf07913000644c2af16e3425cf63c65, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.694366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb0015-3275-4fe5-8509-9d51ceee831a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.695543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814be5-355c-4ef3-bc43-9f4d43897a89 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:28.706001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:28.707596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.708899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.710823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] PATH_INFO: `/v3/projects/92ced65f907046849d94c3397ddd947a/users/a6d59c4ab50d4c71aa97bc55a87b81b6/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.715775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ced65f907046849d94c3397ddd947a, user_id=a6d59c4ab50d4c71aa97bc55a87b81b6, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:28.719400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adda18-0d46-4db0-86a7-ec8fc2337a9e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:28.724866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 824/1630] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:28 2022] PUT /identity/v3/projects/3cf2da5e017b40618f8f60b176afaf23/users/ccf07913000644c2af16e3425cf63c65/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:28.736400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.737345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.737918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.749260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 807/1631] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:28 2022] PUT /identity/v3/projects/92ced65f907046849d94c3397ddd947a/users/a6d59c4ab50d4c71aa97bc55a87b81b6/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:28.751414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:28.751913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:28.753104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:28.800748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] MFA Rules not processed for user `a6d59c4ab50d4c71aa97bc55a87b81b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:28.805939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:28.816810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] MFA Rules not processed for user `ccf07913000644c2af16e3425cf63c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:28.825987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:29.008244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 808/1632] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:29.012739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 825/1633] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:29.019331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:29.029059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:29.149218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbd52e-1655-4b3f-95fa-64a6b543f4f3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:29.158227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3856-f60a-4c93-b354-4efaf1990d49 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:29.159571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:29.160269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.160548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.161614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.166905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:29.169024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.169329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.169612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.184651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:29.187024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d0a2e-ac54-46ff-8b86-0a95cffdb0bc service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:29.192722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:29.198400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0cf68-b267-45dc-a2c0-b431151607b9 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:29.214928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 809/1634] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:29.218829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ccbd-a1f5-439b-8202-f09b758cda40 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.219428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ccbd-a1f5-439b-8202-f09b758cda40 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.220877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ccbd-a1f5-439b-8202-f09b758cda40 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.224720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 826/1635] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:29.224931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 810/1636] 10.222.0.79 () {54 vars in 912 bytes} [Thu May 12 14:37:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:29.230448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.231470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.232469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.259788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:29.261140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:29.424774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ccbd-a1f5-439b-8202-f09b758cda40 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:29.437073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 827/1637] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:29.439956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ccbd-a1f5-439b-8202-f09b758cda40 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:29.449525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:29.450937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.451229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.451512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.486032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:29.500482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770080-8ca2-4cbe-9e79-588740cada85 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:29.509813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:29.510694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.510876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.511197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.527548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:29.532272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc2d0a-56ef-41ed-8dfb-3fe80c8e62e3 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:29.556570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 828/1638] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:29.608989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:29.610614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdf85d-b0e4-47de-96d7-367015a7f903 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:29.629963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 811/1639] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:29.860603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1905-ac43-4297-9652-584ce8dd6649 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:29.860894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1905-ac43-4297-9652-584ce8dd6649 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:29.861170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba1905-ac43-4297-9652-584ce8dd6649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:29.931911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-48ba1905-ac43-4297-9652-584ce8dd6649 None None] MFA Rules not processed for user `6f801c74ab294ea98c631aa74aed8f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:29.936190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-48ba1905-ac43-4297-9652-584ce8dd6649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:30.117133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 829/1640] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:30.129193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b383d-2c00-48c1-a37b-8bbc43ea7944 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:30.129835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b383d-2c00-48c1-a37b-8bbc43ea7944 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:30.130096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b383d-2c00-48c1-a37b-8bbc43ea7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:30.171406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f11b383d-2c00-48c1-a37b-8bbc43ea7944 None None] MFA Rules not processed for user `6f801c74ab294ea98c631aa74aed8f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:30.181380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f11b383d-2c00-48c1-a37b-8bbc43ea7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:30.199077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 812/1641] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:30.217448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c489a8-cbae-4f64-a6b0-1c4fe5684c86 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:30.217850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c489a8-cbae-4f64-a6b0-1c4fe5684c86 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:30.218252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c489a8-cbae-4f64-a6b0-1c4fe5684c86 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:30.220238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 830/1642] 10.222.0.79 () {54 vars in 961 bytes} [Thu May 12 14:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:30.233695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:30.234405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:30.234735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:30.281024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:30.287394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:30.316711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 813/1643] 10.222.0.79 () {58 vars in 1058 bytes} [Thu May 12 14:37:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:30.324616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c489a8-cbae-4f64-a6b0-1c4fe5684c86 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:30.366598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c489a8-cbae-4f64-a6b0-1c4fe5684c86 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:30.389939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:30.390990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:30.393202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:30.393875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:30.416947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:30.425800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a086d-6ce4-4735-b768-1acd73f24380 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:30.444080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 831/1644] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:30.925279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:31.009741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780a46-e06f-4258-b468-b6dbfa2468da None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.010978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780a46-e06f-4258-b468-b6dbfa2468da None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.010978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780a46-e06f-4258-b468-b6dbfa2468da None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.012299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 832/1645] 10.222.0.79 () {54 vars in 912 bytes} [Thu May 12 14:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:37:31.019958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.020688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.021103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.073162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd68e8f-1606-4af7-96d8-99c270cfa138 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:31.074844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:31.076097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:31.084159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:31.085154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.086663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.087672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] PATH_INFO: `/v3/users/4f8a6e0d6f164c64ab7f898bab4e6f9c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.093396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8a6e0d6f164c64ab7f898bab4e6f9c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:31.098974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:31.105772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 833/1646] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:31.121115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:31.123291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:31.197012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8a6e0d6f164c64ab7f898bab4e6f9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:31.222573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8a6e0d6f164c64ab7f898bab4e6f9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:31.224056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8a6e0d6f164c64ab7f898bab4e6f9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:31.225187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8a6e0d6f164c64ab7f898bab4e6f9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:31.237495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb01b9-7dec-41b1-90b2-b1548b1fafdd None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:31.242738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-618da383-7e66-4d93-9708-a7a966cbad3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8a6e0d6f164c64ab7f898bab4e6f9c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:31.244003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:31.244886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.245177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.245448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.248407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:31.265866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 814/1647] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:30 2022] DELETE /identity/v3/users/4f8a6e0d6f164c64ab7f898bab4e6f9c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:31.270757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:31.274747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:31.275505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca6ee-62da-4ef2-892f-89e57563e53e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.278247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca6ee-62da-4ef2-892f-89e57563e53e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.278698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca6ee-62da-4ef2-892f-89e57563e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.305388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 834/1648] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:31.320877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-86eca6ee-62da-4ef2-892f-89e57563e53e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:31.322598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-86eca6ee-62da-4ef2-892f-89e57563e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:31.481784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 815/1649] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:31.569896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:31.571922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:31.720222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175718-bfff-4a9c-99c8-4747c26481d2 service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:31.850712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:31.851444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:31.851757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:31.852039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:31.866978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:31.868728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481560-7f72-4534-9f3f-f64b445f9e4e service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:31.887338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 835/1650] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:32.040140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:32.040262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:32.040635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:32.042441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 816/1651] 10.222.0.79 () {54 vars in 912 bytes} [Thu May 12 14:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:32.065626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:32.066021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:32.066636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:32.184597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:32.192736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:32.208335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 836/1652] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:32.309590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:32.311831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:32.341988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e257-878d-4a5b-bdde-4eac83ba0b2e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:32.351664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:32.352887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:32.353435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:32.353907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:32.365998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:32.369136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:32.385288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 817/1653] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:33.352884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:33.354343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:33.418401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c25e48-7aca-4476-a240-576ba83ae962 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:33.439984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:33.463957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:33.465195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:33.465688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] PATH_INFO: `/v3/projects/978ae8df74584181a38220fae537c6dc` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:33.483046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=978ae8df74584181a38220fae537c6dc)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:33.493520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:33.778469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978ae8df74584181a38220fae537c6dc', 'request_id': 'req-23af3980-26fd-45f7-973e-a01935c11c5b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:33.846194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978ae8df74584181a38220fae537c6dc', 'request_id': 'req-23af3980-26fd-45f7-973e-a01935c11c5b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:33.865864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978ae8df74584181a38220fae537c6dc', 'request_id': 'req-23af3980-26fd-45f7-973e-a01935c11c5b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:33.896107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] The token cache is being invalidate because project 978ae8df74584181a38220fae537c6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:33.896467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:33.900016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-23af3980-26fd-45f7-973e-a01935c11c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:33.904802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 837/1654] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:33 2022] DELETE /identity/v3/projects/978ae8df74584181a38220fae537c6dc => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:33.908865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:33.932126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548b8f-d15f-4d43-80a3-13770dbe5e28 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:34.039975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189264e-d7af-4bd9-9ec3-9a6da6119d08 None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:34.039975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189264e-d7af-4bd9-9ec3-9a6da6119d08 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:34.039975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189264e-d7af-4bd9-9ec3-9a6da6119d08 None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:34.039975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 838/1655] 10.222.0.79 () {54 vars in 960 bytes} [Thu May 12 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:37:34.045654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:34.055333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:34.055333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:34.105506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] MFA Rules not processed for user `053ed1bdb47c44fc8c581c1485fde6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:34.109907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:34.234112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:34.235613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:34.236112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:34.238257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] PATH_INFO: `/v3/users/a6d59c4ab50d4c71aa97bc55a87b81b6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:34.241464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d59c4ab50d4c71aa97bc55a87b81b6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:34.245282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:34.365215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 839/1656] 10.222.0.79 () {58 vars in 1057 bytes} [Thu May 12 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:34.375972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:34.381096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d59c4ab50d4c71aa97bc55a87b81b6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:34.400650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f452-fe33-47d6-a148-e656b098a592 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:34.401397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d59c4ab50d4c71aa97bc55a87b81b6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:34.411962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d59c4ab50d4c71aa97bc55a87b81b6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:34.413074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d59c4ab50d4c71aa97bc55a87b81b6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:34.428120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d59c4ab50d4c71aa97bc55a87b81b6'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:34.430757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:34.431720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:34.432177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:34.432628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:34.439768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:34.464374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 818/1657] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:33 2022] DELETE /identity/v3/users/a6d59c4ab50d4c71aa97bc55a87b81b6 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:34.470194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:34.471947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d8a9-0710-4733-b497-26e2660d4558 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:34.510416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 840/1658] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:35.248346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:35.249841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:35.446235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f620-e501-42c7-94d9-051a6cd3f435 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:35.454531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:35.463874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:35.464382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:35.464798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] PATH_INFO: `/v3/users/7a2da6951ae64b9d93715154b3c605ba` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:35.471200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2da6951ae64b9d93715154b3c605ba)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:35.487079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:35.603279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2da6951ae64b9d93715154b3c605ba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:35.633049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2da6951ae64b9d93715154b3c605ba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:35.634010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2da6951ae64b9d93715154b3c605ba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:35.635657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2da6951ae64b9d93715154b3c605ba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:35.678980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2da6951ae64b9d93715154b3c605ba'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:35.708371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 819/1659] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:35 2022] DELETE /identity/v3/users/7a2da6951ae64b9d93715154b3c605ba => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:35.709873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:35.710723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:35.711214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:35.759152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:35.765609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:35.891206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 841/1660] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:35.955225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:35.957594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:36.065246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361ba2d-5555-4d21-af96-e9aa8d9a3e90 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:36.076913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:36.077777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:36.078158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:36.078534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:36.102788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:36.105200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61804f-bba3-40ab-8e47-1c422074fcf3 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:36.130115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 820/1661] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:36.572824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:36.574492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:36.603369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a942-92ca-486f-b71b-8521eaf54204 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:36.613095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:36.626954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:36.628629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:36.635675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] PATH_INFO: `/v3/projects/92ced65f907046849d94c3397ddd947a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:36.640172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ced65f907046849d94c3397ddd947a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:36.649958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:36.803276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ced65f907046849d94c3397ddd947a', 'request_id': 'req-a23365dc-abce-40f3-91d3-5c07b95380fb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:36.813261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ced65f907046849d94c3397ddd947a', 'request_id': 'req-a23365dc-abce-40f3-91d3-5c07b95380fb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:36.835656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ced65f907046849d94c3397ddd947a', 'request_id': 'req-a23365dc-abce-40f3-91d3-5c07b95380fb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:36.851753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] The token cache is being invalidate because project 92ced65f907046849d94c3397ddd947a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:36.852271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:36.853105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a23365dc-abce-40f3-91d3-5c07b95380fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:36.860583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 842/1662] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:36 2022] DELETE /identity/v3/projects/92ced65f907046849d94c3397ddd947a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:36.862171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:36.862662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:36.863206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:36.907476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:36.913281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:37.095139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 821/1663] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:37.102748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.103505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.106485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.191032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:37.192913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:37.231174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.234821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 843/1664] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:37.246769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6cdc5-7c07-466d-8f4c-c7a713583946 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.275901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.276779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.277063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.277499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.278606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:37.279065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.280865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.312578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 822/1665] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:37.320517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.370592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df8402-330e-4f4c-b117-39f298df4123 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.389289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.390150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.390569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.391040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.392078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.397397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.500240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.501301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 844/1666] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:37 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:37.516651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac9800-534d-480e-aa85-9b4c16f208f4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.616401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.619832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.620684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.621079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.621937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.632446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.693562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.694547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 823/1667] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:37 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:37.709015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaab3-00f3-4671-883f-37cd8f79b04f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.729668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.730656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.731078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.731489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.732385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.734130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.758701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 845/1668] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:37.759088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.776219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbecb9-7944-4084-af94-8cb6c249eda1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.784934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.786716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.787112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.787492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.790059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.793201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31ac9-6a90-4f24-98aa-c470a114ea03 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.836641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 824/1669] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:37.841016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:37.852064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301e42-d4e9-45f9-92db-57ba5abc2f02 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:37.866912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:37.868090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.868514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.868919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] PATH_INFO: `/v3/projects/575627eb804a41109d61b4d3038fc0d6/users/5ac9d9c4f8184eab8fdc9e814a9a31e5/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.900769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575627eb804a41109d61b4d3038fc0d6, user_id=5ac9d9c4f8184eab8fdc9e814a9a31e5, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:37.903439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:37.929873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 846/1670] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:37 2022] PUT /identity/v3/projects/575627eb804a41109d61b4d3038fc0d6/users/5ac9d9c4f8184eab8fdc9e814a9a31e5/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:37:37.940449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:37.941557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:37.942006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:37.994290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] MFA Rules not processed for user `5ac9d9c4f8184eab8fdc9e814a9a31e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:37.995819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:38.142548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 825/1671] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:38.147942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:38.258934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad1ef-5d97-49a1-9010-beee5cd2ef34 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:38.268402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:38.269157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.269440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.269769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.270731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:38.273542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:38.310469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:38.311834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:38.339467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbecc79-f8aa-414c-aacd-678b3017ac8b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:38.349924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 847/1672] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:38 2022] POST /identity/v3/projects => generated 401 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:38.350902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:38.357022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:38.357961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.358244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.358517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] PATH_INFO: `/v3/projects/16f5ef2fef0e45ffa7bb70f56141e6b3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.364985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f5ef2fef0e45ffa7bb70f56141e6b3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:38.365962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: WARNING py.warnings [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:38.365962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: warnings.warn(msg) May 12 14:37:38.365962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: May 12 14:37:38.367323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:38.534185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f5ef2fef0e45ffa7bb70f56141e6b3', 'request_id': 'req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:38.548087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea5a4b-bd90-4458-82fb-04decce9eb57 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:38.555426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f5ef2fef0e45ffa7bb70f56141e6b3', 'request_id': 'req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:38.574114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f5ef2fef0e45ffa7bb70f56141e6b3', 'request_id': 'req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:38.626951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] The token cache is being invalidate because project 16f5ef2fef0e45ffa7bb70f56141e6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:38.628957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:38.629721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7a6e7e5f-37db-4b0a-9406-82b7a547dde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:38.632784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 826/1673] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:38 2022] DELETE /identity/v3/projects/16f5ef2fef0e45ffa7bb70f56141e6b3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:37:38.639617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85b81-a7b4-4fc9-a2e7-9c55490629e9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.640235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85b81-a7b4-4fc9-a2e7-9c55490629e9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.640515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85b81-a7b4-4fc9-a2e7-9c55490629e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.703347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bec85b81-a7b4-4fc9-a2e7-9c55490629e9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:38.713682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bec85b81-a7b4-4fc9-a2e7-9c55490629e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:38.730907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:38.732248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.732525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.732982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.734090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:38.737114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:38.813581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 848/1674] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:38 2022] POST /identity/v3/users => generated 307 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:38.816103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:38.825244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:38.842750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c26df-8676-4069-af08-dbaa422dad13 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:38.849653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:38.850584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.851000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.851434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.853791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:38.856278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:38.880480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 849/1675] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:38.883367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:38.917613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a4a5-e091-492b-bf50-67744f1feb65 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:38.924753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:38.926234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 827/1676] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:38.926558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.927002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.927593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] PATH_INFO: `/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a/users/e753e5c299b344b491300adccd52bd92/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.929694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:38.929694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:38.932002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:38.957268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a192f8230f14971b0d66e8cef5e8f4a, user_id=e753e5c299b344b491300adccd52bd92, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:38.961557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:38.972150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:38.974024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:38.992597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 850/1677] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:38 2022] PUT /identity/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a/users/e753e5c299b344b491300adccd52bd92/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:38.995167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.136681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3611f-7295-46af-80f9-69fd841da22e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.143510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.144401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.144841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.145792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.147211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.149180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.164278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 828/1678] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:39.168317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.176991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 851/1679] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:39.181800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.187033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12c2e-2197-4c5b-94e8-ee7693a956fa None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.198073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550615a5-451a-4c75-a760-13c5ceedc3a8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.200378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.201409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.201849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.202578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.204239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:39.204691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.205965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.206998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.207443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.207907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] PATH_INFO: `/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a/users/e753e5c299b344b491300adccd52bd92/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.209090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.216572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a192f8230f14971b0d66e8cef5e8f4a, user_id=e753e5c299b344b491300adccd52bd92, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.220997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd7e71-0334-4d8b-a745-f348195df43b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.239462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 852/1680] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:39 2022] PUT /identity/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a/users/e753e5c299b344b491300adccd52bd92/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:39.246426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 829/1681] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:39.251207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.252111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.252480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.252859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.269672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af672-cc33-47a8-ab8b-23e48e2dd703 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.299398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] MFA Rules not processed for user `e753e5c299b344b491300adccd52bd92`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:39.305631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:39.360667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.361700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.362175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.362649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.363721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.366077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.412496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 830/1682] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:39.417016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.542199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 853/1683] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:39.557550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.559017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:39.570993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e32fc-dc3f-4faa-a9a7-7bd74b3a9fd2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.576847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.578224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.578534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.578776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.579752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.581894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.633907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 831/1684] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:39 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:37:39.634896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.659107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5459ea-491c-46fd-99bd-d5298c28f63d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.672699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.673431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.673716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.674743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.675885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.678271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.707673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29da8-c195-4a58-8b0b-b20f2ae3dff7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.721726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 832/1685] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:39.722513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.738987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aeac4-b357-4810-b774-b9dd97b46536 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.760206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.761098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.761377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.761649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.762387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.764124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.787494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 833/1686] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:39.788480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:39.811006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691b63-2eb2-4c91-8bdd-ec2a6c55895d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:39.826681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.827851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.828483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.828945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.829292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:39.830208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.830818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.830818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] PATH_INFO: `/v3/projects/953502eb40e24490887dd6cc7009f8c7/users/c89fe6b04b6e45acb29d9cdd0af1f291/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.881485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953502eb40e24490887dd6cc7009f8c7, user_id=c89fe6b04b6e45acb29d9cdd0af1f291, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:39.884205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520558-2d85-4408-a044-fd2d947c0b49 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:39.923478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 834/1687] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:39 2022] PUT /identity/v3/projects/953502eb40e24490887dd6cc7009f8c7/users/c89fe6b04b6e45acb29d9cdd0af1f291/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:39.925804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:39.926155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:39.926529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:39.981804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] MFA Rules not processed for user `c89fe6b04b6e45acb29d9cdd0af1f291`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:39.983069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:40.024238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:40.027002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:40.041670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 854/1688] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:40.173108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 835/1689] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:40.182001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:40.187363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:40.224094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:40.357577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec21a2-844a-43f5-9de2-2ed3de26a3c5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:40.372879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:40.373882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:40.375601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:40.376101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:40.384559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:40.400882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a6b44-a685-4af0-905c-579638692e15 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:40.536906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:40.538541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2144c-1e97-4d46-8691-f2b60ba9452d service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:40.593618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 836/1690] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:40.628563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:40.629522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:40.631631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:40.631631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:40.640844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:40.642807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:40.653257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 855/1691] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:40.980477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530ebd-af28-4254-a9b3-cc2887ddcdcd None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:40.980711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530ebd-af28-4254-a9b3-cc2887ddcdcd None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:40.980995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530ebd-af28-4254-a9b3-cc2887ddcdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.074039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fa530ebd-af28-4254-a9b3-cc2887ddcdcd None None] MFA Rules not processed for user `ab522f0209154f959a431caa01f3a029`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:41.076572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fa530ebd-af28-4254-a9b3-cc2887ddcdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:41.102130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:41.284896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b78e6-5053-43bf-8d2f-1d504768faf0 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:41.304481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 837/1692] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:41.304481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:41.304481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:41.304481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.309527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:41.310587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:41.310968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:41.311345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] PATH_INFO: `/v3/users/c89fe6b04b6e45acb29d9cdd0af1f291` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.313899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89fe6b04b6e45acb29d9cdd0af1f291)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:41.316655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: WARNING py.warnings [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:37:41.316655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: warnings.warn(msg) May 12 14:37:41.316655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: May 12 14:37:41.319898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:41.373756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] MFA Rules not processed for user `99075fda1c7d4e7698e2062407bc2433`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:41.380759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:41.562174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89fe6b04b6e45acb29d9cdd0af1f291'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:41.597929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 838/1693] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:41.603973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:41.608998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:41.653934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89fe6b04b6e45acb29d9cdd0af1f291'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:41.686853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89fe6b04b6e45acb29d9cdd0af1f291'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:41.688957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89fe6b04b6e45acb29d9cdd0af1f291'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:41.696216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08902fa-2c69-4248-b6b2-799beee49bc2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:41.713400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2a2f9ca3-ba63-47e5-8827-b547087de47e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89fe6b04b6e45acb29d9cdd0af1f291'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:41.725473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:41.726552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:41.727236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:41.727962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.733988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:41.741105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 856/1694] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:41 2022] DELETE /identity/v3/users/c89fe6b04b6e45acb29d9cdd0af1f291 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:41.756380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:41.756887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:41.757316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.768930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:41.771275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e07e0-6dbf-4b44-a132-8bed8f11b689 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:41.799260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 839/1695] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:41.800880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:41.803341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:41.805979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:41.849981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:41.858338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:41.898742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] MFA Rules not processed for user `99075fda1c7d4e7698e2062407bc2433`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:41.900795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:42.087327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 857/1696] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:42.101324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 840/1697] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:42.112659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:42.114205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:42.115992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:42.120933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:42.404102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b430-9271-4a08-86ca-cfec87c3d5e8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:42.412978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:42.413665 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:42.413946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:42.414375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:42.437685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:42.439447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaa8d5-fb96-4251-9299-5e321e7a4308 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:42.486998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 858/1698] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:42.488395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:42.488781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:42.489062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:42.518697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619efef-1053-49e9-883c-e7b5d15a7e99 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:42.540964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:42.541840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:42.542124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:42.542402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:42.552067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:42.553301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:42.553981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:42.598697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:42.601797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:42.640102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 841/1699] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:42.797600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 859/1700] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:37:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:43.087921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:43.089810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:43.286759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2d4a6-8461-4664-a775-a29aa74717cd service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:43.303011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:43.304185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:43.305269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:43.307615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:43.336824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:43.339306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e0c7-6186-46a4-b481-b8bd0ca346fb service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:43.362469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 842/1701] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:37:45.571441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:45.573371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:45.649310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac078c-6f99-4eb6-b010-a216aae03009 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:45.671141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:45.677956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:45.677956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:45.677956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] PATH_INFO: `/v3/users/0b5ed933ce4a4f5ea7bb99f3e4bca8e1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:45.682512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5ed933ce4a4f5ea7bb99f3e4bca8e1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:45.695206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:46.247596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5ed933ce4a4f5ea7bb99f3e4bca8e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:46.289634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5ed933ce4a4f5ea7bb99f3e4bca8e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:46.315927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5ed933ce4a4f5ea7bb99f3e4bca8e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:46.316724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5ed933ce4a4f5ea7bb99f3e4bca8e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:46.350155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5ed933ce4a4f5ea7bb99f3e4bca8e1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:46.373736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 860/1702] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:45 2022] DELETE /identity/v3/users/0b5ed933ce4a4f5ea7bb99f3e4bca8e1 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:46.375664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:46.376482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:46.376869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:46.423378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:46.432205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:46.781525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 843/1703] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:47.035647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:47.038089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.065500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bb701-32ad-4998-a631-fa50e40a8e52 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:47.102693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:47.103802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.104083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.104360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] PATH_INFO: `/v3/users/5ac9d9c4f8184eab8fdc9e814a9a31e5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.111656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac9d9c4f8184eab8fdc9e814a9a31e5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:47.113999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:47.138744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:47.140647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.295675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac9d9c4f8184eab8fdc9e814a9a31e5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:47.332882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac9d9c4f8184eab8fdc9e814a9a31e5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:47.366188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac9d9c4f8184eab8fdc9e814a9a31e5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:47.369458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac9d9c4f8184eab8fdc9e814a9a31e5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:47.372959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827371-a143-46c0-a4c2-36847aa1f326 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:47.383747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8829f5ff-6141-4ecc-8e1f-ef54f596ab75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac9d9c4f8184eab8fdc9e814a9a31e5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:47.393144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:47.397707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 861/1704] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:47 2022] DELETE /identity/v3/users/5ac9d9c4f8184eab8fdc9e814a9a31e5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:47.401305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.401643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.401929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.402315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5ff5-d9b5-4b2b-8e9e-4e4bb5978eff None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.402712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5ff5-d9b5-4b2b-8e9e-4e4bb5978eff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.403096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5ff5-d9b5-4b2b-8e9e-4e4bb5978eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.413921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.442392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-217e5ff5-d9b5-4b2b-8e9e-4e4bb5978eff None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:47.443856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-217e5ff5-d9b5-4b2b-8e9e-4e4bb5978eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.477189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:47.485552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:47.534282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 844/1705] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:47.580054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 862/1706] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:47.615634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:47.617140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.642865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835a9e-939b-4d3b-8015-e501fd947970 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:47.797524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:47.798494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.799122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.799611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.818455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.818958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.819399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.827074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:47.831578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:47.860139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:47.861726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.865239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 845/1707] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:47.866710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:47.868669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:47.880675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 863/1708] 10.222.0.85 () {58 vars in 1015 bytes} [Thu May 12 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:47.891503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9400d-afe1-4431-b6a0-3a929f4918df service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:47.898962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:47.900359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:47.900887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:47.901303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] PATH_INFO: `/v3/projects/953502eb40e24490887dd6cc7009f8c7` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:47.904312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953502eb40e24490887dd6cc7009f8c7)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:47.906676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:48.024359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953502eb40e24490887dd6cc7009f8c7', 'request_id': 'req-efa06555-f162-4ad7-afdf-007da6d3d990'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:48.049843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:48.051339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953502eb40e24490887dd6cc7009f8c7', 'request_id': 'req-efa06555-f162-4ad7-afdf-007da6d3d990'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:48.063322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfe87-3d8e-4a73-8a61-61be326ae061 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:48.091499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953502eb40e24490887dd6cc7009f8c7', 'request_id': 'req-efa06555-f162-4ad7-afdf-007da6d3d990'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:48.136226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] The token cache is being invalidate because project 953502eb40e24490887dd6cc7009f8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:48.136731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:48.137703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-efa06555-f162-4ad7-afdf-007da6d3d990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:48.148182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 846/1709] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:47 2022] DELETE /identity/v3/projects/953502eb40e24490887dd6cc7009f8c7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:48.154633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6281-dcf9-45d7-acf9-d83bbd258aa1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.155640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6281-dcf9-45d7-acf9-d83bbd258aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.155640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6281-dcf9-45d7-acf9-d83bbd258aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.257753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6a1d6281-dcf9-45d7-acf9-d83bbd258aa1 None None] MFA Rules not processed for user `8d318a968c834567a30e9788e752cdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:48.263230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:48.264347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6a1d6281-dcf9-45d7-acf9-d83bbd258aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:48.265312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.265701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.266016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.277667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:48.334862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:48.344089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4edef6-112d-4a18-ad1f-76f1cb7cd0e2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:48.377951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 864/1710] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:48.380907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec925-6b87-442b-896b-8e46558f2e23 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.381196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec925-6b87-442b-896b-8e46558f2e23 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.381471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec925-6b87-442b-896b-8e46558f2e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.438269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-163ec925-6b87-442b-896b-8e46558f2e23 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:48.443146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-163ec925-6b87-442b-896b-8e46558f2e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:48.573265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 865/1711] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:48.582716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.583071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.583314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.622017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:48.623290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:48.634122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 866/1712] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:48.638427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:48.686095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 847/1713] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:48.697762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.706559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.710860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.757831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311ac8-9d64-4c81-a596-1eabcd6edc0d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:48.886128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:48.887407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] MFA Rules not processed for user `f7b41d1655e24cf0b1f4bda137115af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:48.893158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:48.919555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:48.922014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:48.931943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:48.934090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:48.935593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:48.944171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:49.071823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 867/1714] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:49.073576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.110330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb211d-331f-4be8-b3be-9ebc4cae381a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:49.137338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:49.138070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:49.138346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:49.138619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:49.139321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:49.156718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:49.280516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 868/1715] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:49 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:49.282403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.295654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:49.305390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 848/1716] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:49.317165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.356883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6274-c7c9-49c0-b79b-726ee0f0c080 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:49.589835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe547-0972-4965-ad60-abb14fbf2e49 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:49.606318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:49.607254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:49.607581 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:49.607922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] PATH_INFO: `/v3/projects/a19bebfab4b04002b724c33fed885456` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:49.617785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19bebfab4b04002b724c33fed885456)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:49.621777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:49.669114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:49.670334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:49.670620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:49.670901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:49.671655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:49.673725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a84e13-ba4e-4313-acd3-424b244491c6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:49.761977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 849/1717] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:49 2022] POST /identity/v3/users => generated 283 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:49.775062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:49.778002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:49.779296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:49.785573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19bebfab4b04002b724c33fed885456', 'request_id': 'req-662c46d0-cbd0-4caa-b540-7df59d6bf732'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.803008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19bebfab4b04002b724c33fed885456', 'request_id': 'req-662c46d0-cbd0-4caa-b540-7df59d6bf732'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.821067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19bebfab4b04002b724c33fed885456', 'request_id': 'req-662c46d0-cbd0-4caa-b540-7df59d6bf732'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.841341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] The token cache is being invalidate because project a19bebfab4b04002b724c33fed885456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:49.841533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.848118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.850592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 869/1718] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:49 2022] DELETE /identity/v3/projects/a19bebfab4b04002b724c33fed885456 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:49.854047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.860873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:49.891573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] MFA Rules not processed for user `99075fda1c7d4e7698e2062407bc2433`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:49.892858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.074072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c46d0-cbd0-4caa-b540-7df59d6bf732 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.091557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.092333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.092823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.093199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.097202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.257375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 850/1719] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:50.257375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.261081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.290214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.299225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.312603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924adf-c3aa-4fbd-bd53-b5dc3a09a12b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.325511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.326877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.328374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.328669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.333621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.339936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 870/1720] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:50.346216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.350382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.576935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c304f-5e41-4877-a1bf-13bedf685815 service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.599462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.600313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.600546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.600788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.602128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.607288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.647661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 871/1721] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:50.662303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.671188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.721994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada58b-bcec-49bc-8a23-ad704de532c4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.748875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.764902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.766299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.766834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] PATH_INFO: `/v3/users/ccf07913000644c2af16e3425cf63c65` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.769218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf07913000644c2af16e3425cf63c65)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.775232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.924266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf07913000644c2af16e3425cf63c65'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.004709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf07913000644c2af16e3425cf63c65'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.026468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf07913000644c2af16e3425cf63c65'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.028928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf07913000644c2af16e3425cf63c65'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.057969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf07913000644c2af16e3425cf63c65'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.083287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 872/1722] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:50 2022] DELETE /identity/v3/users/ccf07913000644c2af16e3425cf63c65 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:51.084291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:51.087111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:51.180359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:51.192286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:51.236211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 851/1723] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 982 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:51.239916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:51.288145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4caa-7e28-487f-b0f7-fff9d239ae63 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:51.417326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083602f3-e9ea-4e93-b477-11d262f3c071 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:51.438206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:51.438683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:51.438964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:51.439238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] PATH_INFO: `/v3/projects/575627eb804a41109d61b4d3038fc0d6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:51.445083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] RBAC: Authorizing `identity:delete_project(project_id=575627eb804a41109d61b4d3038fc0d6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:51.449029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:51.584842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:51.586801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:51.587433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:51.588011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:51.589214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:51.592322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:51.615574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 852/1724] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:51.620710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:51.624106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:51.659714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4544b-fde1-4118-90c1-235eb41ddd40 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:51.690849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575627eb804a41109d61b4d3038fc0d6', 'request_id': 'req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.717504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575627eb804a41109d61b4d3038fc0d6', 'request_id': 'req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.766029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575627eb804a41109d61b4d3038fc0d6', 'request_id': 'req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.853515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] The token cache is being invalidate because project 575627eb804a41109d61b4d3038fc0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:51.853966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.854655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:51.856607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 873/1725] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:51 2022] DELETE /identity/v3/projects/575627eb804a41109d61b4d3038fc0d6 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:51.862752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:51.865050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:52.010254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:52.015077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:52.021177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:52.025185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] PATH_INFO: `/v3/projects/6ce844440a0042efbf141a12dfe1cd03/users/ee8bb729104447658ea00ebcc846dfbd/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:52.088901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce844440a0042efbf141a12dfe1cd03, user_id=ee8bb729104447658ea00ebcc846dfbd, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:52.104891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d45bd5-b571-4922-acf7-eeebd4c6ac86 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:52.137787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927c0c1-a28b-4e4d-b1f8-460ac72b96de admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:52.153336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 853/1726] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:51 2022] PUT /identity/v3/projects/6ce844440a0042efbf141a12dfe1cd03/users/ee8bb729104447658ea00ebcc846dfbd/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:52.159957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:52.161216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:52.161703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:52.241221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] MFA Rules not processed for user `ee8bb729104447658ea00ebcc846dfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:52.246573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:52.327667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:52.332880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:52.334539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:52.334926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] PATH_INFO: `/v3/users/e753e5c299b344b491300adccd52bd92` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:52.341020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e753e5c299b344b491300adccd52bd92)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:52.345253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:52.461842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 854/1727] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:52.468825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:52.476752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:52.498955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e753e5c299b344b491300adccd52bd92'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:52.516085 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28389d3f-f7db-40e0-9ecf-f4a16f993235 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:52.533935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e753e5c299b344b491300adccd52bd92'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:52.540857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:52.542013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:52.543597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:52.544177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:52.545452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:52.548394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4020a0-a339-4775-95c5-d723f7562006 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:52.553961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e753e5c299b344b491300adccd52bd92'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:52.562007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e753e5c299b344b491300adccd52bd92'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:52.585409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e753e5c299b344b491300adccd52bd92'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:52.609626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 874/1728] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:51 2022] DELETE /identity/v3/users/e753e5c299b344b491300adccd52bd92 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:52.649224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 855/1729] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:52 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:52.650671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:52.652652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:52.892396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a397-9ae6-43e3-a864-a7bf3114bf8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.005523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dec4e-2e85-4c83-ac41-1cc2c821662a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.005986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dec4e-2e85-4c83-ac41-1cc2c821662a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.006612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dec4e-2e85-4c83-ac41-1cc2c821662a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.015008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 856/1730] 10.222.0.79 () {54 vars in 912 bytes} [Thu May 12 14:37:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:53.019539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.020061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.020559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.037017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.038195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.038577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.038902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.043353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.046470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.097641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 875/1731] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:52 2022] POST /identity/v3/users => generated 290 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:53.100145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.110110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:53.112053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:53.124198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9b886-edee-4a5d-b04f-63632e006ccd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.136676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.138663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.140280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.140595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.143546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.153418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.181948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 876/1732] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:53.184391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.219250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d52cd-76d9-4b6a-a108-05dc8d4fa658 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.232502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.236515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.236948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.237945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] PATH_INFO: `/v3/projects/cc324dec1b5e4c3084bec86bae3667c0/users/325c862bbc6f4db495a5dfdf64f26b72/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.263378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 857/1733] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:37:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:53.284688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc324dec1b5e4c3084bec86bae3667c0, user_id=325c862bbc6f4db495a5dfdf64f26b72, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.289271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.354402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 877/1734] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:53 2022] PUT /identity/v3/projects/cc324dec1b5e4c3084bec86bae3667c0/users/325c862bbc6f4db495a5dfdf64f26b72/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:53.355283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.389803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206c3e-3f5d-4f67-b50e-8f68eff39610 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.426937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.429363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:53.575014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.575883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.576332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.576830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.578429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.584545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379d91e-59f6-4b7b-beac-da293c3ba3cb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.585101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.602382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.603357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.603839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.604496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.617481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 858/1735] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:53.618645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.619026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.620727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16094c1-383e-4929-ac5f-ffde5f20a2b7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.637580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d8b7-631f-4eea-be01-5318810fecbf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:53.652876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:53.655056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.655776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.656514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] PATH_INFO: `/v3/projects/cc324dec1b5e4c3084bec86bae3667c0/users/325c862bbc6f4db495a5dfdf64f26b72/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.660218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc324dec1b5e4c3084bec86bae3667c0, user_id=325c862bbc6f4db495a5dfdf64f26b72, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:53.670360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 878/1736] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:37:53.684046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:53.732921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 859/1737] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:53 2022] PUT /identity/v3/projects/cc324dec1b5e4c3084bec86bae3667c0/users/325c862bbc6f4db495a5dfdf64f26b72/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:53.749631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:53.750118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:53.750514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:53.792612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:53.794662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:53.873194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] MFA Rules not processed for user `325c862bbc6f4db495a5dfdf64f26b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:53.875864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:53.993931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecd2a-707b-45f2-aa32-e7697ec05e0b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.016989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.018007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.018492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.018867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] PATH_INFO: `/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.022516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a192f8230f14971b0d66e8cef5e8f4a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.024643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.079898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 879/1738] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.080930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.087251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.120163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837e7a2-ce34-4076-9ea0-f1425f06106a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.144061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.145747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.146170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.146565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] PATH_INFO: `/v3/projects/3cf2da5e017b40618f8f60b176afaf23` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.150397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf2da5e017b40618f8f60b176afaf23)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.152622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.249934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a192f8230f14971b0d66e8cef5e8f4a', 'request_id': 'req-c82e7dd7-aae7-48b0-b9a5-179827ed840d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.257223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf2da5e017b40618f8f60b176afaf23', 'request_id': 'req-88ad4128-0b9a-4806-9660-7bab6e727e29'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.275681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf2da5e017b40618f8f60b176afaf23', 'request_id': 'req-88ad4128-0b9a-4806-9660-7bab6e727e29'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.276956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a192f8230f14971b0d66e8cef5e8f4a', 'request_id': 'req-c82e7dd7-aae7-48b0-b9a5-179827ed840d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.296022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf2da5e017b40618f8f60b176afaf23', 'request_id': 'req-88ad4128-0b9a-4806-9660-7bab6e727e29'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.296248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a192f8230f14971b0d66e8cef5e8f4a', 'request_id': 'req-c82e7dd7-aae7-48b0-b9a5-179827ed840d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.314274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] The token cache is being invalidate because project 3cf2da5e017b40618f8f60b176afaf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:54.314853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.315799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.319069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 880/1739] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:54 2022] DELETE /identity/v3/projects/3cf2da5e017b40618f8f60b176afaf23 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:54.320228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.321907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.333709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] The token cache is being invalidate because project 3a192f8230f14971b0d66e8cef5e8f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:54.334115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.341729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c82e7dd7-aae7-48b0-b9a5-179827ed840d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:54.350016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 860/1740] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:37:53 2022] DELETE /identity/v3/projects/3a192f8230f14971b0d66e8cef5e8f4a => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:54.353371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4a0d-147c-4d8c-85b8-13224f65290e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.357531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4a0d-147c-4d8c-85b8-13224f65290e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.357904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf4a0d-147c-4d8c-85b8-13224f65290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.423060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad4128-0b9a-4806-9660-7bab6e727e29 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.424509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-adbf4a0d-147c-4d8c-85b8-13224f65290e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:54.426342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-adbf4a0d-147c-4d8c-85b8-13224f65290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.442836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.444187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.445538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.446233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.458208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.682964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 861/1741] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.685296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7627-9e2f-4967-8909-38fe311e143b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.689528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7627-9e2f-4967-8909-38fe311e143b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.690093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc7627-9e2f-4967-8909-38fe311e143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.701724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.703339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714ad24-7c15-42c7-bac7-9cf3146ebdce service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.749146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-70bc7627-9e2f-4967-8909-38fe311e143b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:54.750695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-70bc7627-9e2f-4967-8909-38fe311e143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.756324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 881/1742] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:54.758007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.760001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.760476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.774360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 862/1743] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.782469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.783193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.783621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.810007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:54.811582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.825049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 882/1744] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.830920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.838067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:54.842323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.846150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0de34-ef71-4e4a-9bdc-8f1f91e905c2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.853709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.855306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.855794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.856210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.857136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:54.857589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.859963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.867374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 863/1745] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.869594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.900438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfe035-3292-49c1-9bdf-985965c84e93 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.903737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 883/1746] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:54.912783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.914010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.914516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.914945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.915565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.917846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:54.918418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.922787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.957473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c04bd6-94b5-4db6-91b0-6c9a13201c6d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.974027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.974208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 864/1747] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:54.975114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.975398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.975675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.976433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.976683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.984015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.985370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.026957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425691-4133-42b5-8166-696bc2ee0c57 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.039359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.040490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.040988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.041704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.044089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:55.058289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 884/1748] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:55.059442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.194249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.198171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.226340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 865/1749] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:55.229094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.259617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff307ad7-e913-4045-94bb-e600ecef3ffd service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.267810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fc1ea-d47f-42b7-8d82-bede37406f1f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.274104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.276487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.277229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.277814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.277814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.278655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.279086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.279974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.280802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.281793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.287373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d570-45d6-4123-90eb-72c1195b02cc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.300336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.339272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 866/1750] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:55 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:55.339272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a53e9-845b-4328-9e4e-13451b0db41a None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.342695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a53e9-845b-4328-9e4e-13451b0db41a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.343923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a53e9-845b-4328-9e4e-13451b0db41a None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.348352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 867/1751] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:37:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:37:55.350875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a53e9-845b-4328-9e4e-13451b0db41a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.379444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 885/1752] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:55 2022] POST /identity/v3/projects => generated 387 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:55.382843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.385064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a53e9-845b-4328-9e4e-13451b0db41a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.594267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97be2-a884-4add-9bdc-b654f0e638ac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.608360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.608627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.610761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.611285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.611867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.612011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.612198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.612671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.613122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.613968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.618168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.618550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.666355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 886/1753] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:55 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:55.681210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.681332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 868/1754] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:55.682175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.708457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8dd9-f2fd-4cba-a74c-f012b10a74ec admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.719916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7a3bd-f61c-4966-8d18-e2a2c9f0398e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.724535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.726691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.728584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.729638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.730509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.732245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.739804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.741038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.741690 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.743389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.745642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.751017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.778660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 887/1755] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:55.782754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.784673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 869/1756] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:55.801929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.812995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8d7a-446a-434a-80ce-6e99c747e038 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.824538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.825412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.826522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.826640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfbad8-ea87-4ec9-bd4a-a5954e5236e3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.826733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.828243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.830744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.838401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.840886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.841392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.841844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] PATH_INFO: `/v3/projects/f874503189694ff0a90829a75909448e/users/9dd329d1314e45ac8b6fa476909d341e/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.865038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 888/1757] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:55.866561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:55.905401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f874503189694ff0a90829a75909448e, user_id=9dd329d1314e45ac8b6fa476909d341e, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.910004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9521-3256-4a36-9e1b-b7ee95cac491 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:55.914770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a30312-b159-45f0-936a-4738a1cc69bc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:55.929697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:55.933843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.935732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.936027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] PATH_INFO: `/v3/projects/8e32dbda9b2a46ed9980c35e85962d01/users/99f4abcb72e04316aeeaf8d278708206/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.959145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 870/1758] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:55 2022] PUT /identity/v3/projects/f874503189694ff0a90829a75909448e/users/9dd329d1314e45ac8b6fa476909d341e/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:55.974919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e32dbda9b2a46ed9980c35e85962d01, user_id=99f4abcb72e04316aeeaf8d278708206, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:55.975284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:55.975284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:55.975450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:55.977815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7877c-d168-42f5-9297-78a0989ac60a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.037107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 889/1759] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:55 2022] PUT /identity/v3/projects/8e32dbda9b2a46ed9980c35e85962d01/users/99f4abcb72e04316aeeaf8d278708206/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:56.041431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679618-272f-4212-909a-57cd1a3db8e3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.042091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679618-272f-4212-909a-57cd1a3db8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.042376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679618-272f-4212-909a-57cd1a3db8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.072348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] MFA Rules not processed for user `9dd329d1314e45ac8b6fa476909d341e`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:56.081894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:56.093082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c8679618-272f-4212-909a-57cd1a3db8e3 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:56.094626 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c8679618-272f-4212-909a-57cd1a3db8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:56.197795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 890/1760] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:56.199292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.199582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.199928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.245588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] MFA Rules not processed for user `99f4abcb72e04316aeeaf8d278708206`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:56.246977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:56.339367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 891/1761] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:56.345810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.364099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 871/1762] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:56.369601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.459012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8899-dde6-4fff-a7e6-d2b4d9dc095e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.469983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.470761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.471724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.473374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.475477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.477602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.507773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec6d1-ad50-4d7b-9486-ca8dd7e4995e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.514408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.516801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.517524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.518007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.519054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.521579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.592125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 892/1763] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:56.596064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.604882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 872/1764] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:37:56.618177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.795705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3dd2-aeda-420e-b776-cc0f560b05ac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.811955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.813836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9499-1d08-45ed-b0f4-8662a487dc01 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.816072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.816877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.817170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.825265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.829923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.833430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.834175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.835138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.835421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.838770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.849340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.887873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 893/1765] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/users => generated 301 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:56.893676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.900811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 873/1766] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:56.918098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:56.922822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca708-5ba5-4f6f-98f7-31a3f54ffd03 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.936950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.939873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.940274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.940615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.945273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.950925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537bacd-4b54-439b-a535-e2b5ed73f44d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.951321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f49c4-7e62-4c5a-a3bf-eaea7c642b3f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:56.972076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:56.974885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.976529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.976770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:56.989744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:56.991570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:56.996181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 894/1767] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:56.998601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:56.998894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:56.999176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.010209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 874/1768] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:57.011377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.031244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2dba0-43d4-4c3f-a9a4-e64f208fd6ca admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.048782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] MFA Rules not processed for user `f7b41d1655e24cf0b1f4bda137115af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:57.053258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.053577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:57.056122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.057139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.058773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] PATH_INFO: `/v3/projects/a92912a039464c538ae7e9c012c7f186/users/b70f99aedbfe4cf8b502eb913086b9bf/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.117725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92912a039464c538ae7e9c012c7f186, user_id=b70f99aedbfe4cf8b502eb913086b9bf, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.121068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.147160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 875/1769] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:57 2022] PUT /identity/v3/projects/a92912a039464c538ae7e9c012c7f186/users/b70f99aedbfe4cf8b502eb913086b9bf/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:57.148014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.228923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 895/1770] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:57.229994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.231827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:57.343046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3a6b-bbc8-42b3-a448-e8d7df50d24f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.362314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.363360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.363636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.363953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] PATH_INFO: `/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044/users/1aaf980fdb35472999868ecb2a5f4b93/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.392084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23853f-de54-4ef7-a693-4d35f83c32af None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.415035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dda63667deb49f9bdb0e3e4f4fd3044, user_id=1aaf980fdb35472999868ecb2a5f4b93, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.415035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.464683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 876/1771] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:57 2022] PUT /identity/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044/users/1aaf980fdb35472999868ecb2a5f4b93/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:57.465959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.648811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4089a8-50c3-4eb4-89da-8e8660bc82b8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.677023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.679294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.680295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.680943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.681182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.681539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.681767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.682144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.687437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.689441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.697985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.700778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.740201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 877/1772] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:57.741564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.743911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 896/1773] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:57.745023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.760656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4131-8f33-4a92-8865-48ef782e515b service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.781733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.787022 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.790024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.790804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] PATH_INFO: `/v3/projects/a92912a039464c538ae7e9c012c7f186/users/b70f99aedbfe4cf8b502eb913086b9bf/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.799486 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51954281-1f98-4d7e-abb9-4561e95878fc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:57.803356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92912a039464c538ae7e9c012c7f186, user_id=b70f99aedbfe4cf8b502eb913086b9bf, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.815196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730e53d-7ee7-4783-b383-94c47fb0a220 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.817271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:57.818513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.824603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.825012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.825931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:57.836971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:57.854436 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 897/1774] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:57 2022] PUT /identity/v3/projects/a92912a039464c538ae7e9c012c7f186/users/b70f99aedbfe4cf8b502eb913086b9bf/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:57.873580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:57.874178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:57.874706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:57.912709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 878/1775] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:57.913899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:57.965392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] MFA Rules not processed for user `b70f99aedbfe4cf8b502eb913086b9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:57.967471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:57.982213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088488e9-8fb8-493f-abe5-4f3aa95e3b2d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:58.173353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:58.174254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:58.174888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:58.176922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] PATH_INFO: `/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044/users/1aaf980fdb35472999868ecb2a5f4b93/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:58.182130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dda63667deb49f9bdb0e3e4f4fd3044, user_id=1aaf980fdb35472999868ecb2a5f4b93, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:58.196772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0149-a27f-4fec-b764-b2341f09df80 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:58.220041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 879/1776] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:37:57 2022] PUT /identity/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044/users/1aaf980fdb35472999868ecb2a5f4b93/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:58.235018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:58.235476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:58.235870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:58.297485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 898/1777] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:58.310442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] MFA Rules not processed for user `1aaf980fdb35472999868ecb2a5f4b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:58.310840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:58.312288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:58.312614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:58.483227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ffb7-becd-4a07-b5e6-2590849721d7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:58.495345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 880/1778] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:58.517769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:58.633536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:58.633928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17efaa-4ff6-46ef-9166-cfa108e251cc None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:58.634827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:58.635262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:58.635744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:58.639798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:58.640649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:58.641043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:58.641413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:58.686605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:58.689015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:58.723160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 881/1779] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:58.771417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:58.773802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e88c5-5995-4b88-8b4d-f46328130069 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:58.810569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 899/1780] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:59.135674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:59.352391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b815f-c3bf-40b2-9eb2-7e0c7aed092c service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:59.364328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:59.366449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:59.366929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:59.367793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] PATH_INFO: `/v3/users/99f4abcb72e04316aeeaf8d278708206` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:59.371039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f4abcb72e04316aeeaf8d278708206)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:59.374253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:59.493672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f4abcb72e04316aeeaf8d278708206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:59.531490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f4abcb72e04316aeeaf8d278708206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:59.537170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f4abcb72e04316aeeaf8d278708206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:59.537170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f4abcb72e04316aeeaf8d278708206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:59.564688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f4abcb72e04316aeeaf8d278708206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:59.608309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 882/1781] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:59 2022] DELETE /identity/v3/users/99f4abcb72e04316aeeaf8d278708206 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:59.611918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:59.613262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:59.613685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:59.655105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:59.656383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:59.811445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:59.814217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:59.847256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 900/1782] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:59.860916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:59.865322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.002389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622430-6eb0-4508-a11f-b8650b965bbc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:00.008739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:00.009854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.010140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.010430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] PATH_INFO: `/v3/users/9dd329d1314e45ac8b6fa476909d341e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.016383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd329d1314e45ac8b6fa476909d341e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:00.018390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:00.068992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3695-2dba-4c18-afcf-62961e52251a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:00.088256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:00.089365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.090327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.090847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.115837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:00.117673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b06d1-a1f2-42a0-9e85-2267284ad277 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:00.120798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd329d1314e45ac8b6fa476909d341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.145283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd329d1314e45ac8b6fa476909d341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.146585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd329d1314e45ac8b6fa476909d341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.147541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd329d1314e45ac8b6fa476909d341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.162450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd329d1314e45ac8b6fa476909d341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.181982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 901/1783] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:00.190186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 883/1784] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:37:59 2022] DELETE /identity/v3/users/9dd329d1314e45ac8b6fa476909d341e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:00.194643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2314b-ae82-494a-a8b6-7e1bd63eb6f4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.194940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2314b-ae82-494a-a8b6-7e1bd63eb6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.195209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2314b-ae82-494a-a8b6-7e1bd63eb6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.249207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2af2314b-ae82-494a-a8b6-7e1bd63eb6f4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:00.255536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2af2314b-ae82-494a-a8b6-7e1bd63eb6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.386227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 902/1785] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:00.443770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:00.443770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.589620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e04d3-93d7-408e-a59c-b7ed55b1b2df admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:00.606271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:00.607013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.607290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.607615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.628604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:00.630229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:00.653447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 884/1786] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:00.681358 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.682284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.682284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.714244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] MFA Rules not processed for user `ab522f0209154f959a431caa01f3a029`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:00.715888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.726475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:00.727897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.750834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a570-11f0-4b38-8d43-09264ea74d27 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:00.765409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:00.766310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.766587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.766858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] PATH_INFO: `/v3/projects/8e32dbda9b2a46ed9980c35e85962d01` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.769741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e32dbda9b2a46ed9980c35e85962d01)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:00.773380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:00.829047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 903/1787] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:00.874975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e32dbda9b2a46ed9980c35e85962d01', 'request_id': 'req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.882560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e32dbda9b2a46ed9980c35e85962d01', 'request_id': 'req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.896031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e32dbda9b2a46ed9980c35e85962d01', 'request_id': 'req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.916455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] The token cache is being invalidate because project 8e32dbda9b2a46ed9980c35e85962d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:00.917047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.918432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:00.921123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 885/1788] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:00 2022] DELETE /identity/v3/projects/8e32dbda9b2a46ed9980c35e85962d01 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:00.926644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:00.945138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcaac6-656a-424b-be9e-88da37379a4f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:01.054543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:01.056172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:01.057034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:01.057034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] PATH_INFO: `/v3/users/b70f99aedbfe4cf8b502eb913086b9bf` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:01.061727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70f99aedbfe4cf8b502eb913086b9bf)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:01.064976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:01.141748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70f99aedbfe4cf8b502eb913086b9bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:01.180799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70f99aedbfe4cf8b502eb913086b9bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:01.200630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70f99aedbfe4cf8b502eb913086b9bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:01.201548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70f99aedbfe4cf8b502eb913086b9bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:01.213288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70f99aedbfe4cf8b502eb913086b9bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:01.236329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 904/1789] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:00 2022] DELETE /identity/v3/users/b70f99aedbfe4cf8b502eb913086b9bf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:01.703141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:01.705295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:01.750778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3fee-2e85-4d0f-9e6b-fdc32791bba5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:01.872801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:01.875030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:01.985455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:01.988464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:01.989341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:01.991170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] PATH_INFO: `/v3/projects/a92912a039464c538ae7e9c012c7f186` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:01.992130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725b15-c29c-42c1-af0f-6e0fc6427b61 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:01.995052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92912a039464c538ae7e9c012c7f186)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:01.999413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.001164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.002245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.002672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.003433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] PATH_INFO: `/v3/projects/f874503189694ff0a90829a75909448e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.005086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f874503189694ff0a90829a75909448e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.015763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.090261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f874503189694ff0a90829a75909448e', 'request_id': 'req-cf36225a-612f-4e3e-adb5-d82b86da8002'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.096474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f874503189694ff0a90829a75909448e', 'request_id': 'req-cf36225a-612f-4e3e-adb5-d82b86da8002'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.100790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92912a039464c538ae7e9c012c7f186', 'request_id': 'req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.108379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92912a039464c538ae7e9c012c7f186', 'request_id': 'req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.116702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f874503189694ff0a90829a75909448e', 'request_id': 'req-cf36225a-612f-4e3e-adb5-d82b86da8002'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.119634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92912a039464c538ae7e9c012c7f186', 'request_id': 'req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.133323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] The token cache is being invalidate because project f874503189694ff0a90829a75909448e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:02.133624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.135480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.137106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 905/1790] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:01 2022] DELETE /identity/v3/projects/f874503189694ff0a90829a75909448e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:02.141154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.144355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.149390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] The token cache is being invalidate because project a92912a039464c538ae7e9c012c7f186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:02.151490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.153590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a5b956f2-2811-4032-bd7d-d5e0ed139bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.156190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 886/1791] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:01 2022] DELETE /identity/v3/projects/a92912a039464c538ae7e9c012c7f186 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:02.162466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736808f6-668c-4509-afe8-525a97af4856 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.165057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736808f6-668c-4509-afe8-525a97af4856 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.165570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736808f6-668c-4509-afe8-525a97af4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.197948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-736808f6-668c-4509-afe8-525a97af4856 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:02.200609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-736808f6-668c-4509-afe8-525a97af4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.253424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36225a-612f-4e3e-adb5-d82b86da8002 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.262763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.263676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.263997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.264258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] PATH_INFO: `/v3/users/1aaf980fdb35472999868ecb2a5f4b93` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.265769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaf980fdb35472999868ecb2a5f4b93)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.268040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.385006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 887/1792] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:02.389353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.389647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.389892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.400294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaf980fdb35472999868ecb2a5f4b93'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.431494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaf980fdb35472999868ecb2a5f4b93'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.433551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:02.434810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.447804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaf980fdb35472999868ecb2a5f4b93'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.448906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaf980fdb35472999868ecb2a5f4b93'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.465597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaf980fdb35472999868ecb2a5f4b93'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:02.468605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 888/1793] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:02.469553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.473622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 906/1794] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:02 2022] DELETE /identity/v3/users/1aaf980fdb35472999868ecb2a5f4b93 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:02.512695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0dde-31e5-4785-a7ca-13f8a28ed762 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.623823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.625327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.657899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.660844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.662153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.662900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.664341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:02.666225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.668666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.697875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 889/1795] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:02.699424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.703453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.723050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c52d26-8298-4bc0-b745-a4e5150c0afe admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.736762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.737790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.738346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.738773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.739888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.743827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.797686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 890/1796] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:02 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:02.802322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.803102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a282927-0524-43d1-ac03-39b20fcb4564 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.909593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.917368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.917859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.918278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] PATH_INFO: `/v3/users/ee8bb729104447658ea00ebcc846dfbd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.920629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8bb729104447658ea00ebcc846dfbd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.922826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.931505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff996-9a4a-4e9b-b2d4-81c68784c5fc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.946533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.947208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.947833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.948254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.949121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.951312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.998010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 891/1797] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:02 2022] POST /identity/v3/users => generated 305 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:03.003591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.019396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8bb729104447658ea00ebcc846dfbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.023211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273f0c-7687-456a-9237-22d4e3300f37 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.033756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.035214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.035573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.036015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.036866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.039391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.047991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8bb729104447658ea00ebcc846dfbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.055246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 892/1798] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:03.055246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.055736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.063327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8bb729104447658ea00ebcc846dfbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.064201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8bb729104447658ea00ebcc846dfbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.082083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8bb729104447658ea00ebcc846dfbd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.084348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc897e-6690-43a2-a48b-a9bd2b776dd4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.094479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 907/1799] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:02 2022] DELETE /identity/v3/users/ee8bb729104447658ea00ebcc846dfbd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:03.095399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.096696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.096983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.097083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.097425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] PATH_INFO: `/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.098643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.099184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dda63667deb49f9bdb0e3e4f4fd3044)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.102552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.153347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dda63667deb49f9bdb0e3e4f4fd3044', 'request_id': 'req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.160142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dda63667deb49f9bdb0e3e4f4fd3044', 'request_id': 'req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.168529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dda63667deb49f9bdb0e3e4f4fd3044', 'request_id': 'req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.173039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4039e3-dc94-4c3a-b33d-ff5c72471a3d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.184317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] The token cache is being invalidate because project 5dda63667deb49f9bdb0e3e4f4fd3044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:03.184726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.185841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d9a273b5-b99f-4600-b18d-6de6b7dea1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:03.190357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 893/1800] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:03 2022] DELETE /identity/v3/projects/5dda63667deb49f9bdb0e3e4f4fd3044 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:03.190357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29fb68-b867-47f6-bd51-484cd4056826 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.190357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29fb68-b867-47f6-bd51-484cd4056826 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.190357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29fb68-b867-47f6-bd51-484cd4056826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.207651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3d29fb68-b867-47f6-bd51-484cd4056826 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:03.208957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3d29fb68-b867-47f6-bd51-484cd4056826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.263662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.264700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.265353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.265641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.266761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.268577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355c9ad-6fc4-461b-926b-2d74c576c5b5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.279503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 894/1801] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:03.280998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 908/1802] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:03.282233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.282489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.282584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.282900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.283291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.284381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.307172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:03.308182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.308349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] MFA Rules not processed for user `8d318a968c834567a30e9788e752cdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:03.309562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.318368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 909/1803] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:03.319002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.320391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.332201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770e33f-27cf-484d-a5cb-dd4210d699e9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.338364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.339242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.339521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.339892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] PATH_INFO: `/v3/projects/963666d59a684183a92c72aaa95bc672/users/93e9131cac914ac68df860252abc5de1/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.356261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=963666d59a684183a92c72aaa95bc672, user_id=93e9131cac914ac68df860252abc5de1, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.359090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce2ef-3d30-4645-bae4-44f8bad714ed admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.383833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 895/1804] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:03.385158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.389061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 910/1805] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:03 2022] PUT /identity/v3/projects/963666d59a684183a92c72aaa95bc672/users/93e9131cac914ac68df860252abc5de1/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:03.389202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.390576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e8a7-a391-4d18-8af5-f1b80f4f5340 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.390876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e8a7-a391-4d18-8af5-f1b80f4f5340 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.391218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e8a7-a391-4d18-8af5-f1b80f4f5340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.424830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-85b9e8a7-a391-4d18-8af5-f1b80f4f5340 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:03.426509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-85b9e8a7-a391-4d18-8af5-f1b80f4f5340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.477731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c77c6-4081-4966-b394-8cac98ae4ca6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.554093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 911/1806] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:03.555754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.556252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.556728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.582276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.583589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.583980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.584323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.620881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] MFA Rules not processed for user `93e9131cac914ac68df860252abc5de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:03.622117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:03.629193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.630823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.641562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 896/1807] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:03.657810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.679976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c127f-854b-4aed-98f2-1560858dbb3f service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.686501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.687562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.687946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.688280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.689482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:03.689788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.692455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.729319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 897/1808] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:03.733885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.754534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63deb6a5-e2e8-4a57-8124-108e8283b415 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.762299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.763678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.764237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.764697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.766108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.776400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 912/1809] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:03.778168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.779393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.799353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c83533-a8a7-43d6-beeb-8593a8a9b82a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.812441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.813214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.813592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.814266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.815122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.825965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 898/1810] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/projects => generated 353 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:03.827802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:03.832826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.882128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 913/1811] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:03.885502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:03.939298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1b06-c366-4439-bf43-7c26e472dfba admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.974216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184eadc-a36a-480e-8654-3a5f96a176f1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:03.985890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:03.986617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:03.986891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:03.987327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:03.988415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:03.990593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.030608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 914/1812] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/users => generated 311 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:04.032287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.047129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5607b9-16ad-4157-b355-69e731288863 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.061733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.064274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.064911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.065395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.066767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.069527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.085785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.086520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.086803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.087080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.087813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.089290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 915/1813] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:04.092624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.093996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.108376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b4bb-513d-4dd1-8898-d53de3f9d7ba admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.120551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.122298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.122854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.123435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] PATH_INFO: `/v3/projects/7b430995ba9b4272b95f26dc3597189c/users/9df385d31957475fb1985ac289ded7d6/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.134451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 899/1814] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:03 2022] POST /identity/v3/users => generated 277 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:04.138500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.156968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b430995ba9b4272b95f26dc3597189c, user_id=9df385d31957475fb1985ac289ded7d6, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.158120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60087c2-930e-4c94-98cc-c6f0d03fd03d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.168518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.169666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.170115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.171425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.173107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.173763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.174879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.193418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 900/1815] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:04.195006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.197125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:04.214057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 916/1816] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:04 2022] PUT /identity/v3/projects/7b430995ba9b4272b95f26dc3597189c/users/9df385d31957475fb1985ac289ded7d6/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:04.215426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.275418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24a60b-657c-459d-b545-e449f4ad585b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.354643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa925-cbf9-4db5-ab10-b37873043a6c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.372298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.372574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.373965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.374070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.374454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] PATH_INFO: `/v3/projects/6ce844440a0042efbf141a12dfe1cd03` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.375996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce844440a0042efbf141a12dfe1cd03)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.379642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.380119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.380466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.380755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.385859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.387640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.436794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 917/1817] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:04.438045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.463501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a94d-da15-4a00-85bd-2a577a12031a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.483392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce844440a0042efbf141a12dfe1cd03', 'request_id': 'req-a7982b55-a1cc-4815-9acd-170e86a07ceb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.496476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce844440a0042efbf141a12dfe1cd03', 'request_id': 'req-a7982b55-a1cc-4815-9acd-170e86a07ceb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.514290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce844440a0042efbf141a12dfe1cd03', 'request_id': 'req-a7982b55-a1cc-4815-9acd-170e86a07ceb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.560953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] The token cache is being invalidate because project 6ce844440a0042efbf141a12dfe1cd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:04.561287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.566496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.570832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 901/1818] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:04 2022] DELETE /identity/v3/projects/6ce844440a0042efbf141a12dfe1cd03 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:04.571835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.574710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:04.615408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.616021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.616370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.616755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.617708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.619535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.654473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 918/1819] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:04.656421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.661352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:04.684008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fc2a-ae0f-4a9e-ac40-17ce6964733d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.703491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.704869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.706111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.706698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] PATH_INFO: `/v3/users/325c862bbc6f4db495a5dfdf64f26b72` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.709640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325c862bbc6f4db495a5dfdf64f26b72)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.713491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.727360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7982b55-a1cc-4815-9acd-170e86a07ceb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.733651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.735425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.735943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.736471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] PATH_INFO: `/v3/projects/b295a8f988ac48819c73247101654e44/users/ded8517a422242ce91a18c65db1b5f46/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.753078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b295a8f988ac48819c73247101654e44, user_id=ded8517a422242ce91a18c65db1b5f46, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.756495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.772382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 902/1820] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:04 2022] PUT /identity/v3/projects/b295a8f988ac48819c73247101654e44/users/ded8517a422242ce91a18c65db1b5f46/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:04.773589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:04.778002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:04.795230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325c862bbc6f4db495a5dfdf64f26b72'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.827928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325c862bbc6f4db495a5dfdf64f26b72'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.837891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325c862bbc6f4db495a5dfdf64f26b72'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.838655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325c862bbc6f4db495a5dfdf64f26b72'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.854774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-af247e37-2d95-48f2-8ef9-78205a47f561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325c862bbc6f4db495a5dfdf64f26b72'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:04.866980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 919/1821] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:04 2022] DELETE /identity/v3/users/325c862bbc6f4db495a5dfdf64f26b72 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:04.868542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.868859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.869171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.894717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06300a10-2d5e-44d4-9f8e-9f75e65811f9 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:04.945236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] MFA Rules not processed for user `ded8517a422242ce91a18c65db1b5f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:04.946458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:04.970451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:04.971744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:04.972514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:04.972710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] PATH_INFO: `/v3/projects/7b430995ba9b4272b95f26dc3597189c/users/9df385d31957475fb1985ac289ded7d6/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:04.975554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b430995ba9b4272b95f26dc3597189c, user_id=9df385d31957475fb1985ac289ded7d6, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:04.980683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4ca8-90b2-4075-b0b4-0a468db1e595 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:04.996317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 903/1822] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:04 2022] PUT /identity/v3/projects/7b430995ba9b4272b95f26dc3597189c/users/9df385d31957475fb1985ac289ded7d6/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:05.007505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.008014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.008656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.042209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] MFA Rules not processed for user `9df385d31957475fb1985ac289ded7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:05.043921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.057753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 920/1823] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:04 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:05.062508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.064516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.079708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34483-bf6e-4ebf-b8a7-e6bb16db5e22 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.118792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 904/1824] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:05.130139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.131670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.139321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.140057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.140344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.140623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.141481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.143429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.174531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 921/1825] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:05 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:05.176644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.193146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893f14-a537-4da3-9f1b-7653243165df None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.239440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e417-4c38-48cd-a170-89b813b795df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.246442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.247193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.247546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.247948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.248695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.250022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.250712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.250992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.251092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.251267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.278734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 922/1826] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:05 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:05.280839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.293714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a58e94-e7f8-4a0a-8ce0-5f53b27905e7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.300224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.301260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.301834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.302175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.303107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.305177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.320447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 923/1827] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:05.323921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.335306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c107b2-ed4e-410a-93ce-59c54e9e8619 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.341002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5832-719b-4562-879a-29533515386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.343334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5832-719b-4562-879a-29533515386e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.343334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5832-719b-4562-879a-29533515386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.343334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5832-719b-4562-879a-29533515386e admin admin] PATH_INFO: `/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9/users/f2b91ef17ce244f2b0ba79dc634ee39d/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.361330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5832-719b-4562-879a-29533515386e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac351a0ed0a4cecb00ca35af3d010c9, user_id=f2b91ef17ce244f2b0ba79dc634ee39d, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.365060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5832-719b-4562-879a-29533515386e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.386455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 924/1828] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:05 2022] PUT /identity/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9/users/f2b91ef17ce244f2b0ba79dc634ee39d/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:05.389090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.390750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.392169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5832-719b-4562-879a-29533515386e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.404240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 905/1829] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:05 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:05.472353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5832-719b-4562-879a-29533515386e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.478124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.479062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.479457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.479806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.480604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.482254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946bf6-7b63-443b-8175-4b521f494bfe admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.499379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 925/1830] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:05.500698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.522318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972825e-719b-4e5e-b20c-576dcac9a158 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.528496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.529996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.531170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.531632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] PATH_INFO: `/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9/users/f2b91ef17ce244f2b0ba79dc634ee39d/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.534504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac351a0ed0a4cecb00ca35af3d010c9, user_id=f2b91ef17ce244f2b0ba79dc634ee39d, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.539435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.557485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 906/1831] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:05 2022] PUT /identity/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9/users/f2b91ef17ce244f2b0ba79dc634ee39d/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:05.569909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.570366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.570867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.609965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] MFA Rules not processed for user `f2b91ef17ce244f2b0ba79dc634ee39d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:05.611529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.689279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.791754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 926/1832] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:05.807544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:05.809237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.825786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f48dcf-db96-45a4-8349-b48d2d4e3808 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.843746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b168-9ab9-404a-b38a-574aa0486ca5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:05.857116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.857786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.858071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.858350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.865839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:05.866558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:05.866847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:05.867132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:05.870211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:05.904601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:05.906062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:05.932800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 927/1833] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:06.047958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:06.050049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:06.064858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:06.075928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 907/1834] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:06.077001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55f2da-c4b2-4cf2-b824-29c7d61805c0 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:06.082250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:06.083095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:06.083486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:06.083718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:06.179144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:06.183919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e341c1-f2d2-4da7-8c51-6f4abc2fd885 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:06.201047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 928/1835] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:06 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:06.489432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:06.490981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:06.686931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658f3dd-478f-4397-9656-df4f259a92b6 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:06.723157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:06.726149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:06.726722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:06.727193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] PATH_INFO: `/v3/projects/cc324dec1b5e4c3084bec86bae3667c0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:06.730284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc324dec1b5e4c3084bec86bae3667c0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:06.739953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:06.871612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc324dec1b5e4c3084bec86bae3667c0', 'request_id': 'req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:06.881694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc324dec1b5e4c3084bec86bae3667c0', 'request_id': 'req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:06.899083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc324dec1b5e4c3084bec86bae3667c0', 'request_id': 'req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:06.914594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] The token cache is being invalidate because project cc324dec1b5e4c3084bec86bae3667c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:06.915044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:06.915838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-50a3e994-8ba2-48c7-bfb4-3ee43fe77fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:06.930922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 908/1836] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:06 2022] DELETE /identity/v3/projects/cc324dec1b5e4c3084bec86bae3667c0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:06.936398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:06.936603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:06.937033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:06.957835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:06.959180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:07.047036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 929/1837] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:07.055674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.056005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.056351 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.080114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:07.082095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:07.091372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 909/1838] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:07.096302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.120018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faf949-dffa-40d7-bfc2-fb11b8bf1ce4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.127357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.128073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.128422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.128693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.129441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:07.129749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.131370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.166176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 930/1839] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:07.167489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.186516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894912ef-41d9-45f9-8fee-f9cc6179b223 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.202738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.205155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.205640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.207084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.209230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.214487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.296452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.296821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 910/1840] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:07 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:07.308749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df670de6-4c3e-4050-b828-7884b60174c9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.460157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.483865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.484412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.484953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.486023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.488704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.553118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.573025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 931/1841] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:07 2022] POST /identity/v3/users => generated 281 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:07.575451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d2d8-c363-4fc1-887b-6a907d4b72a2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.605681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.606404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.607069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.607625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.608463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.613353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.635152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.645479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 911/1842] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:07.670691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d90de6-7d98-4ae1-85d4-acb9a4286222 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.697622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.698686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.699670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.699670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.700619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.702464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abd255-6ae2-4728-9c23-570477beb4f4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.719411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 932/1843] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:07.722549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:07.738781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f83318-f47e-4838-b4d3-1f3d125bc0ff admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:07.749574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:07.752240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.755572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.756155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] PATH_INFO: `/v3/projects/ac57e68e734b402a8324bd271c818d18/users/e565007175b443f69c88ce36a97f55fa/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.787227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac57e68e734b402a8324bd271c818d18, user_id=e565007175b443f69c88ce36a97f55fa, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:07.793198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:07.831827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 912/1844] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:07 2022] PUT /identity/v3/projects/ac57e68e734b402a8324bd271c818d18/users/e565007175b443f69c88ce36a97f55fa/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:07.835251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:07.835251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:07.835251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:07.988455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] MFA Rules not processed for user `e565007175b443f69c88ce36a97f55fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:07.995383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:08.256558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 933/1845] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:08.287220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:08.290709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:08.410404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1782a-b5c7-4fac-8768-4ea94b141517 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:08.414972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:08.415746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:08.416033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:08.416305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:08.427332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:08.428865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54c964-1285-4bd7-9ba5-942a8c59ade8 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:08.443356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 913/1846] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:08.459555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:08.562352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6399-dedb-4abb-866b-bf4fe2ff71d8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:08.569075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:08.570152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:08.570872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:08.571160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] PATH_INFO: `/v3/users/e565007175b443f69c88ce36a97f55fa` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:08.572672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e565007175b443f69c88ce36a97f55fa)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:08.575172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:08.590859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958dd3a-2f0a-4b22-9a30-f6408baec6c8 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:08.591734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958dd3a-2f0a-4b22-9a30-f6408baec6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:08.591734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958dd3a-2f0a-4b22-9a30-f6408baec6c8 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:08.593162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 914/1847] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:38:08.603125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:08.603394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:08.604066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:08.642616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:08.643879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:08.650496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e565007175b443f69c88ce36a97f55fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:08.667785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e565007175b443f69c88ce36a97f55fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:08.676939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e565007175b443f69c88ce36a97f55fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:08.678008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e565007175b443f69c88ce36a97f55fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:08.692343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-08b38988-4983-40e6-aeed-fb6e7d3db8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e565007175b443f69c88ce36a97f55fa'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:08.708068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 934/1848] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:08 2022] DELETE /identity/v3/users/e565007175b443f69c88ce36a97f55fa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:08.710430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:08.711147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:08.711621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:08.753046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:08.757238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:08.780512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 915/1849] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:08.850814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 935/1850] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:08.868666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:08.871083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:08.950700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37930e-ae8d-481f-baed-77e3a2f35ca1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:09.029967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:09.030783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:09.031722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:09.031722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:09.046057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:09.047548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2550-4660-408c-a622-6d68dbf4c767 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:09.075305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 916/1851] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:09.216423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:09.216423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:09.384348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f29cd-c4e7-4956-9fe8-8643767e666f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:09.406769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:09.407543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:09.407917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:09.408365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:09.422457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:09.425978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd0932-1d8b-4136-a128-20a03ec16a30 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:09.446334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 936/1852] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:09.637520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0e725-a964-4fe8-8489-b2e349c618df None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:09.637973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0e725-a964-4fe8-8489-b2e349c618df None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:09.638326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0e725-a964-4fe8-8489-b2e349c618df None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:09.640224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 917/1853] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:38:09.662369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:09.662690 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:09.662960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:09.698078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:09.699299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:09.720956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 937/1854] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:38:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:09.792426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0e725-a964-4fe8-8489-b2e349c618df None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:09.840689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0e725-a964-4fe8-8489-b2e349c618df None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:09.847581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:09.848574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:09.849168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:09.849855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:09.890590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:09.892519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7993c8-bf0b-4335-8629-695edf9b98ba service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:09.934006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 918/1855] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:10.056392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.058483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.088529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7a83-08ca-449b-918f-a450f360cf0c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.093893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.094981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.095428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.095898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] PATH_INFO: `/v3/projects/ac57e68e734b402a8324bd271c818d18` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.097746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac57e68e734b402a8324bd271c818d18)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.099949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.173805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac57e68e734b402a8324bd271c818d18', 'request_id': 'req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:10.183350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac57e68e734b402a8324bd271c818d18', 'request_id': 'req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:10.191721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac57e68e734b402a8324bd271c818d18', 'request_id': 'req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:10.203253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] The token cache is being invalidate because project ac57e68e734b402a8324bd271c818d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:10.203714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:10.204433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fccda1e6-3dbc-45bf-8439-f1ec2f4d2507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:10.206077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 938/1856] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:10 2022] DELETE /identity/v3/projects/ac57e68e734b402a8324bd271c818d18 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:10.211324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.211681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.211986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.231320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:10.232593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.293325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 919/1857] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:10.301550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.301792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.302068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.322134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:10.323339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.331360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 939/1858] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:10.336238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.350124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d105507-1315-4b94-b4c6-d332bc647d91 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.358020 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.358880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.359278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.359623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.360630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:10.360998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.362832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.384183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 920/1859] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:10.388873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.401048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d8a8-83b2-4e63-87b5-04a9b1889e64 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.408959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.410398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.411329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.411329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.411797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.414016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.454867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 940/1860] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:10.459541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.475887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad597b-52e5-489a-8471-1a45b900d93c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.539985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.541098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.541603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.541952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.542892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.545768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.571592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 921/1861] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:10.575651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.587570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50424-4ce6-4afa-a483-0a0945ab40c7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.595610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.596351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.596635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.596913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.597901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.599541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.610982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 941/1862] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:10.616152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.628791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba866-2c75-4bef-98b4-0c1ee2b5901e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.636539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.637251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.637536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.638081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.638617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.640203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c167ce-e11f-49a3-adb6-2ca1980f6601 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.652632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 922/1863] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:10.661481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.672661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb195c-4aec-4ab1-b87a-9eae6e6eeb3b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.678109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.679011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.679357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.679632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] PATH_INFO: `/v3/projects/eeba321debcd40e6ba9eb9a5c1e534ce/users/35fc8699f921492282b5be9b5fab5b24/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.695760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeba321debcd40e6ba9eb9a5c1e534ce, user_id=35fc8699f921492282b5be9b5fab5b24, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.698403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.713496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 942/1864] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:10 2022] PUT /identity/v3/projects/eeba321debcd40e6ba9eb9a5c1e534ce/users/35fc8699f921492282b5be9b5fab5b24/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:10.718796 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2080-a3f1-44f5-b288-21b17d4872d7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.719114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2080-a3f1-44f5-b288-21b17d4872d7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.719395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2080-a3f1-44f5-b288-21b17d4872d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.737259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d71e2080-a3f1-44f5-b288-21b17d4872d7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:10.738477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d71e2080-a3f1-44f5-b288-21b17d4872d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.808465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 923/1865] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:10.818658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:10.820674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.883077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b60e-ae11-49a3-9404-6fced3f1c84b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:10.887002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:10.887666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.888043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.888320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.899041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:10.900559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:10.910224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 943/1866] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:11.745605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff1d4-e608-4c67-9fae-69c7640630b8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:11.746543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff1d4-e608-4c67-9fae-69c7640630b8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:11.747009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff1d4-e608-4c67-9fae-69c7640630b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:11.776596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-151ff1d4-e608-4c67-9fae-69c7640630b8 None None] MFA Rules not processed for user `35fc8699f921492282b5be9b5fab5b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:11.777896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-151ff1d4-e608-4c67-9fae-69c7640630b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.859938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 924/1867] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:11.868855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:11.870301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.940747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc4305-ebad-4784-85f1-bf96e6221ef7 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:11.945096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:11.945860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:11.946145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:11.946424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:11.956115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:11.958361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:11.968455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 944/1868] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:14.387043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4433-86a4-4490-8ed0-c90df6029281 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:14.388021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4433-86a4-4490-8ed0-c90df6029281 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:14.388301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4433-86a4-4490-8ed0-c90df6029281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:14.407909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d28c4433-86a4-4490-8ed0-c90df6029281 None None] MFA Rules not processed for user `35fc8699f921492282b5be9b5fab5b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:14.409576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d28c4433-86a4-4490-8ed0-c90df6029281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:14.422614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 925/1869] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:16.391738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:16.393180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:16.432594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752405ae-adb4-4bcb-990e-547f7c1a07ba service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:16.451817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:16.452935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:16.453652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:16.454151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] PATH_INFO: `/v3/users/93e9131cac914ac68df860252abc5de1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:16.455935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e9131cac914ac68df860252abc5de1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:16.460607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:16.531407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e9131cac914ac68df860252abc5de1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:16.545195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e9131cac914ac68df860252abc5de1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:16.553050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e9131cac914ac68df860252abc5de1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:16.553929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e9131cac914ac68df860252abc5de1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:16.561853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e9131cac914ac68df860252abc5de1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:16.568774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 945/1870] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:16 2022] DELETE /identity/v3/users/93e9131cac914ac68df860252abc5de1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:16.573054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:16.573519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:16.573609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:16.602735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:16.605765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:16.694564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 926/1871] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:16.704662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:16.707172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:16.769260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622236b-61bc-4e13-9f7f-3db3301366bf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:16.776179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:16.777675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:16.778300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:16.778778 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:16.789650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:16.791225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:16.818030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 946/1872] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:17.381397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:17.383254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:17.395546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515617-a0c5-4f56-ab96-dfd79d2f9282 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:17.400324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:17.401209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:17.401485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:17.401966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] PATH_INFO: `/v3/projects/963666d59a684183a92c72aaa95bc672` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:17.403148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963666d59a684183a92c72aaa95bc672)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:17.405236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:17.453057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963666d59a684183a92c72aaa95bc672', 'request_id': 'req-da1dfebe-9a2d-48dd-9850-41dc33ddc418'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.458430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963666d59a684183a92c72aaa95bc672', 'request_id': 'req-da1dfebe-9a2d-48dd-9850-41dc33ddc418'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.466587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963666d59a684183a92c72aaa95bc672', 'request_id': 'req-da1dfebe-9a2d-48dd-9850-41dc33ddc418'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.479524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] The token cache is being invalidate because project 963666d59a684183a92c72aaa95bc672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:17.479992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.481101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.483709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 927/1873] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:17 2022] DELETE /identity/v3/projects/963666d59a684183a92c72aaa95bc672 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:17.488247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:17.499058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57467c1-880d-424f-ae36-46bd6e8bf5f9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:17.556943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:17.558097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:17.558376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:17.558649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] PATH_INFO: `/v3/users/9df385d31957475fb1985ac289ded7d6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:17.559900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df385d31957475fb1985ac289ded7d6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:17.561819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:17.620387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df385d31957475fb1985ac289ded7d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.635229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df385d31957475fb1985ac289ded7d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.642033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df385d31957475fb1985ac289ded7d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.642815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df385d31957475fb1985ac289ded7d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.651434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-3bf001df-bc00-4481-84cd-4e3ecbdbcb81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df385d31957475fb1985ac289ded7d6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:17.658083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 947/1874] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:17 2022] DELETE /identity/v3/users/9df385d31957475fb1985ac289ded7d6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:17.943618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:17.945231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:17.982699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dfebe-9a2d-48dd-9850-41dc33ddc418 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.044481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.045764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.046162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.046503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] PATH_INFO: `/v3/projects/7b430995ba9b4272b95f26dc3597189c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.047815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b430995ba9b4272b95f26dc3597189c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.049740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.099061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b430995ba9b4272b95f26dc3597189c', 'request_id': 'req-4148bf22-a6b6-4008-b06a-e3a86be9578a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:18.105154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b430995ba9b4272b95f26dc3597189c', 'request_id': 'req-4148bf22-a6b6-4008-b06a-e3a86be9578a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:18.114618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b430995ba9b4272b95f26dc3597189c', 'request_id': 'req-4148bf22-a6b6-4008-b06a-e3a86be9578a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:18.125553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] The token cache is being invalidate because project 7b430995ba9b4272b95f26dc3597189c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:18.125834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:18.126497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4148bf22-a6b6-4008-b06a-e3a86be9578a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:18.128206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 928/1875] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:17 2022] DELETE /identity/v3/projects/7b430995ba9b4272b95f26dc3597189c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:18.133214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.133507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.133790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.152454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:18.153619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:18.213747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 948/1876] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:18.222533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.222533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.222533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.241549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:18.242742 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:18.250891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 929/1877] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:18.255327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.265406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6bf7b-3d5a-4cc5-b916-0910d7bdf560 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.270853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.271514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.271824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.272095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.272824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:18.273146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.274773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.287171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 949/1878] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:18.291709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.301255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cceb49-87c5-404c-a211-6eb835fb2562 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.307720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.308404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.308708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.308982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.309673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.311584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.344304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 930/1879] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:18.350887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.362096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892850e-2b30-4619-9de4-a63fa69f712a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.424990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.425699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.425982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.426326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.426940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.428893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.456299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 950/1880] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:18.458413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.469021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aee35-8299-4b37-be2b-dd12b215bf6a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.473831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.474620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.474931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.475211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.476001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.477725 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.488622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 931/1881] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:18.493119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.503208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6eff-96a9-498a-98c2-71c8c9d33ae3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.508056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.508729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.509171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.509607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.510587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.512228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c299-74fb-4f2e-b6be-f2052fe5c358 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.523040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 951/1882] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:18.527097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.538065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7a08f-b0bc-4763-b6eb-00f833f796a8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.543372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.544518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.545156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.545481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] PATH_INFO: `/v3/projects/2abeb6d7d75046a1a7060e92abfbb075/users/036451fe5d0943f9bb2b69ac759a5883/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.567609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abeb6d7d75046a1a7060e92abfbb075, user_id=036451fe5d0943f9bb2b69ac759a5883, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.570921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.587039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 932/1883] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:18 2022] PUT /identity/v3/projects/2abeb6d7d75046a1a7060e92abfbb075/users/036451fe5d0943f9bb2b69ac759a5883/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:18.598752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.599506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.599974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.628234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] MFA Rules not processed for user `036451fe5d0943f9bb2b69ac759a5883`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:18.629467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:18.708166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 952/1884] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:18.712810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.785731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728449c-b74a-4e28-af9e-c47433bb86fd admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.791676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.792468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.792815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.793173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.793950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.796904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.834653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 933/1885] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:18.838708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.854170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a903a6-207e-480b-8931-7ad7a80d68d1 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.910058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.910848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.911168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.911454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.912188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.914107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.937390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 953/1886] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:18 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:18.941619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.951842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffcc63-1092-4bf0-8ff0-1ca4c3d62e40 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.956671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.957377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.957653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.957923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.958642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.960278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:18.970731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 934/1887] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:18.975332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:18.985498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969697-c210-45ed-8766-ecef0c275016 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:18.990834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:18.991518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:18.991848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:18.992145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:18.992871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:18.994467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf05ac-be8f-4dec-b498-19c27f6f0f77 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.004710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 954/1888] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:19.008846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.018984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749ac7e-fdd4-4807-8893-a7ddb2c2a863 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.025051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.025970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.026248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.026847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] PATH_INFO: `/v3/projects/ce178d3df97a4d35a70843238934785f/users/e3757892b555479fab448a962f51e6a6/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.045759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce178d3df97a4d35a70843238934785f, user_id=e3757892b555479fab448a962f51e6a6, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.049321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.066097 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 935/1889] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:19 2022] PUT /identity/v3/projects/ce178d3df97a4d35a70843238934785f/users/e3757892b555479fab448a962f51e6a6/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:19.076214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.076578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.077109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.110719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] MFA Rules not processed for user `e3757892b555479fab448a962f51e6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:19.112479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:19.177823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 955/1890] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:19.182217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.245384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68904d3a-2f22-4cf0-8403-9bb9e8d98489 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.250083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.250755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.251032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.251306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.252045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.254264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.281146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 936/1891] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:19 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:19.285333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.296400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e17a3-1cdb-4e83-b91c-93cf9efeeb79 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.356980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.357816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.358095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.358369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.359328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.363721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.392790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 956/1892] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:19 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:19.397585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.416677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f38dd1-a1d7-40af-a0df-8f6e17786a0e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.426255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.427478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.427999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.428609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.429521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.431347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.446358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 937/1893] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:19.451326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.466491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507593-5cdb-40b7-9c8b-aa8403b10bb1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.479511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.481554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.482361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.483026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] PATH_INFO: `/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2/users/b7d5b88e7dac457a84cb8607b444f699/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.509798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f12a90c29642f2aa1cbd0fbcf489f2, user_id=b7d5b88e7dac457a84cb8607b444f699, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.515879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.535821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 957/1894] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:19 2022] PUT /identity/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2/users/b7d5b88e7dac457a84cb8607b444f699/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:19.539000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.555411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b448156-42f4-4849-8fde-8d59ea6a9439 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.640908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.641634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.641961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.642241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.643067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.645460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb1290-8c9e-45f2-9974-a163e3bd59b4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.660746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 938/1895] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:19.662213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.674300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f80f-a57b-42b9-b54e-2a7049e7072a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.679212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.680277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.680560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.680833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] PATH_INFO: `/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2/users/b7d5b88e7dac457a84cb8607b444f699/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.683065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f12a90c29642f2aa1cbd0fbcf489f2, user_id=b7d5b88e7dac457a84cb8607b444f699, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.685738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.696642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 958/1896] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:19 2022] PUT /identity/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2/users/b7d5b88e7dac457a84cb8607b444f699/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:19.706643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.707082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.707569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.734243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] MFA Rules not processed for user `b7d5b88e7dac457a84cb8607b444f699`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:19.735457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:19.800354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 939/1897] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:19.811585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.813571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:19.882672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017fff-b05b-42b0-9ef7-85911787e3fc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.886438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.887120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.887398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.887771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:19.899442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:19.901172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:19.914596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 959/1898] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:19.961727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:19.972025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6585acb-a92a-4522-9581-696f061a5c4f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:19.976013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:19.976782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:19.977202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:19.977367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:20.074394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:20.076342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b4088-4fca-4790-963c-3ba3762ae912 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:20.090920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 940/1899] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:24.184336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:24.262509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8d302-0e91-4c46-9200-792f07762c3a service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:24.267842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:24.268976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:24.269434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:24.270007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] PATH_INFO: `/v3/users/036451fe5d0943f9bb2b69ac759a5883` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:24.271411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=036451fe5d0943f9bb2b69ac759a5883)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:24.273553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:24.335897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036451fe5d0943f9bb2b69ac759a5883'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.343403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036451fe5d0943f9bb2b69ac759a5883'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.350508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036451fe5d0943f9bb2b69ac759a5883'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.351258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036451fe5d0943f9bb2b69ac759a5883'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.359666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036451fe5d0943f9bb2b69ac759a5883'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.365831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 960/1900] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:24 2022] DELETE /identity/v3/users/036451fe5d0943f9bb2b69ac759a5883 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:24.371375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:24.371915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:24.372069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:24.390049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:24.391252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:24.448460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 941/1901] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:24.458916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:24.460449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:24.519218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49d073-4fb5-4105-8b18-23f86a1102ca admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:24.523481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:24.524184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:24.524465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:24.524727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:24.534249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:24.535711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:24.545954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 961/1902] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:24.894300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:24.896149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:24.913702 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb7b16-e11a-465f-b098-053495563b0c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:24.918506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:24.919399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:24.920070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:24.920343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] PATH_INFO: `/v3/projects/2abeb6d7d75046a1a7060e92abfbb075` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:24.921668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abeb6d7d75046a1a7060e92abfbb075)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:24.923755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:24.977306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abeb6d7d75046a1a7060e92abfbb075', 'request_id': 'req-f49c7b14-1566-45df-a950-8b4d087314cf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:24.983527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abeb6d7d75046a1a7060e92abfbb075', 'request_id': 'req-f49c7b14-1566-45df-a950-8b4d087314cf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.007184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abeb6d7d75046a1a7060e92abfbb075', 'request_id': 'req-f49c7b14-1566-45df-a950-8b4d087314cf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.020036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] The token cache is being invalidate because project 2abeb6d7d75046a1a7060e92abfbb075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:25.020327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.021149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.022783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 942/1903] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:24 2022] DELETE /identity/v3/projects/2abeb6d7d75046a1a7060e92abfbb075 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:25.026821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:25.037953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772888-d8d9-46bd-aa18-28e717ac2b7c service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:25.099365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:25.100314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:25.100627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:25.100900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] PATH_INFO: `/v3/users/e3757892b555479fab448a962f51e6a6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:25.102106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3757892b555479fab448a962f51e6a6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:25.104079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:25.151567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3757892b555479fab448a962f51e6a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.163348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3757892b555479fab448a962f51e6a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.170173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3757892b555479fab448a962f51e6a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.170865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3757892b555479fab448a962f51e6a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.179107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e588bbcc-0167-4bf4-91ee-1a4bf3a77237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3757892b555479fab448a962f51e6a6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:25.185110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 962/1904] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:25 2022] DELETE /identity/v3/users/e3757892b555479fab448a962f51e6a6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:25.975481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:25.977861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:25.993668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c7b14-1566-45df-a950-8b4d087314cf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.071212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.072231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.072591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.072922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] PATH_INFO: `/v3/users/ded8517a422242ce91a18c65db1b5f46` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.074226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded8517a422242ce91a18c65db1b5f46)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.076316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.123404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded8517a422242ce91a18c65db1b5f46'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.135841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded8517a422242ce91a18c65db1b5f46'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.136567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded8517a422242ce91a18c65db1b5f46'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.137230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded8517a422242ce91a18c65db1b5f46'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.145929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded8517a422242ce91a18c65db1b5f46'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.158295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 943/1905] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:25 2022] DELETE /identity/v3/users/ded8517a422242ce91a18c65db1b5f46 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:26.163092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.163387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.163667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.182674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:26.183931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:26.243955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 963/1906] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:26.253954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:26.255381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:26.320654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807caf0-6447-4a85-9a22-e2f1e1ca7c57 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.325007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.325861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.326339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.326669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.338022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.342346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.343717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:26.345327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:26.357943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0616c48-6617-4dfc-952c-f967f20cafaf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.359794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 944/1907] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:26.363614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.364855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.365343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.365726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] PATH_INFO: `/v3/projects/ce178d3df97a4d35a70843238934785f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.367075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce178d3df97a4d35a70843238934785f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.369348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.441790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce178d3df97a4d35a70843238934785f', 'request_id': 'req-86a8f73e-cf88-403d-93a4-eb005ed7e898'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.448138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce178d3df97a4d35a70843238934785f', 'request_id': 'req-86a8f73e-cf88-403d-93a4-eb005ed7e898'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.458967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce178d3df97a4d35a70843238934785f', 'request_id': 'req-86a8f73e-cf88-403d-93a4-eb005ed7e898'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.474263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] The token cache is being invalidate because project ce178d3df97a4d35a70843238934785f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:26.474613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.475491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.477564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 964/1908] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:26 2022] DELETE /identity/v3/projects/ce178d3df97a4d35a70843238934785f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:26.481610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:26.492348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325fe97-f8e4-43be-8ce4-e310283c6b5f service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.562621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.563896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.564179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.564455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] PATH_INFO: `/v3/users/b7d5b88e7dac457a84cb8607b444f699` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.565781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d5b88e7dac457a84cb8607b444f699)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.568002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.618395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d5b88e7dac457a84cb8607b444f699'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.630369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d5b88e7dac457a84cb8607b444f699'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.631223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d5b88e7dac457a84cb8607b444f699'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.631960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d5b88e7dac457a84cb8607b444f699'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.640667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d5b88e7dac457a84cb8607b444f699'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.654650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 945/1909] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:26 2022] DELETE /identity/v3/users/b7d5b88e7dac457a84cb8607b444f699 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:26.657435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:26.659100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:26.672562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8f73e-cf88-403d-93a4-eb005ed7e898 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.733087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.734011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.734290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.734569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] PATH_INFO: `/v3/projects/b295a8f988ac48819c73247101654e44` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.735869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b295a8f988ac48819c73247101654e44)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.738226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.792488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b295a8f988ac48819c73247101654e44', 'request_id': 'req-fe63c864-ebad-4e29-8153-9dc2b19981dd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.798770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b295a8f988ac48819c73247101654e44', 'request_id': 'req-fe63c864-ebad-4e29-8153-9dc2b19981dd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.808667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b295a8f988ac48819c73247101654e44', 'request_id': 'req-fe63c864-ebad-4e29-8153-9dc2b19981dd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.835808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] The token cache is being invalidate because project b295a8f988ac48819c73247101654e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:26.835808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.839808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.839808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 965/1910] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:26 2022] DELETE /identity/v3/projects/b295a8f988ac48819c73247101654e44 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:26.842420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:26.844075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:26.857432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5556-4f9b-43bd-bbbf-a98a9aa906ad admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:26.913283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:26.914246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:26.914500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:26.914772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] PATH_INFO: `/v3/users/f2b91ef17ce244f2b0ba79dc634ee39d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:26.916237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b91ef17ce244f2b0ba79dc634ee39d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:26.918195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:26.980664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b91ef17ce244f2b0ba79dc634ee39d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.998202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b91ef17ce244f2b0ba79dc634ee39d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:26.999553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b91ef17ce244f2b0ba79dc634ee39d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.000203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b91ef17ce244f2b0ba79dc634ee39d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.011236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8b010b9c-281e-43a2-893f-ea019e26575f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b91ef17ce244f2b0ba79dc634ee39d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.024984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 946/1911] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:26 2022] DELETE /identity/v3/users/f2b91ef17ce244f2b0ba79dc634ee39d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:27.273162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.275324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.291313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c864-ebad-4e29-8153-9dc2b19981dd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:27.369504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:27.370813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.371282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.371844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] PATH_INFO: `/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.379334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f12a90c29642f2aa1cbd0fbcf489f2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:27.381650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:27.453997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f12a90c29642f2aa1cbd0fbcf489f2', 'request_id': 'req-10f5d9b4-9bc7-45f8-9466-a58456967cc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.462618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f12a90c29642f2aa1cbd0fbcf489f2', 'request_id': 'req-10f5d9b4-9bc7-45f8-9466-a58456967cc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.475884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f12a90c29642f2aa1cbd0fbcf489f2', 'request_id': 'req-10f5d9b4-9bc7-45f8-9466-a58456967cc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.492863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] The token cache is being invalidate because project c4f12a90c29642f2aa1cbd0fbcf489f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:27.493513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.494530 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.501797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 966/1912] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:27 2022] DELETE /identity/v3/projects/c4f12a90c29642f2aa1cbd0fbcf489f2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:27.503575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458b4b-ab1c-46e6-a9bf-6111fe34b81a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.503889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458b4b-ab1c-46e6-a9bf-6111fe34b81a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.504164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458b4b-ab1c-46e6-a9bf-6111fe34b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.520572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.523288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.547291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fa458b4b-ab1c-46e6-a9bf-6111fe34b81a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:27.553176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fa458b4b-ab1c-46e6-a9bf-6111fe34b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.620911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5d9b4-9bc7-45f8-9466-a58456967cc7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:27.626934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:27.627970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.628265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.628543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] PATH_INFO: `/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.630534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac351a0ed0a4cecb00ca35af3d010c9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:27.632565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:27.666536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 947/1913] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:27.677626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.678016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.679457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.697628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac351a0ed0a4cecb00ca35af3d010c9', 'request_id': 'req-4eb906c8-a174-47f8-9add-d8d793773e21'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.705357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac351a0ed0a4cecb00ca35af3d010c9', 'request_id': 'req-4eb906c8-a174-47f8-9add-d8d793773e21'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.715219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac351a0ed0a4cecb00ca35af3d010c9', 'request_id': 'req-4eb906c8-a174-47f8-9add-d8d793773e21'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.715495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:27.716770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.729280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] The token cache is being invalidate because project 9ac351a0ed0a4cecb00ca35af3d010c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:27.729618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.730309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4eb906c8-a174-47f8-9add-d8d793773e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:27.732124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 967/1914] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:27 2022] DELETE /identity/v3/projects/9ac351a0ed0a4cecb00ca35af3d010c9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:27.737402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86da0e-7ae0-4d83-961a-563790294e69 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.737845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86da0e-7ae0-4d83-961a-563790294e69 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.738127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86da0e-7ae0-4d83-961a-563790294e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.757367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a86da0e-7ae0-4d83-961a-563790294e69 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:27.758925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a86da0e-7ae0-4d83-961a-563790294e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.794374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 948/1915] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:27.800029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.811216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b357c-c2c1-45e9-95b2-52c3a22e8868 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:27.822043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:27.822043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.822043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.822043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.822547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:27.822547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:27.822547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:27.861993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 949/1916] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:38:27.862920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.870887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 968/1917] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:27.878340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.878652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.879010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.894501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c75d7-90be-48e1-94d2-e23874d3879e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:27.907323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:27.907809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.908093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.909266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.911418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:27.913735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:27.923008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:27.924250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:27.935807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 969/1918] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:27.937269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.949668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb637a-272e-4378-897f-7d1fe7a630a5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:27.954313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 950/1919] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:27.954596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:27.955335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:27.955793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:27.956158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:27.957386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:27.958270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.958398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:27.960635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:27.974454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 970/1920] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:38:27.978572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:27.991079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d92aa-9ebe-4192-b267-417eeff8225c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.032359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa95e5-b2ff-47ef-b0ba-f5d206aa9295 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.038541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.039785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.040381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.040827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.041546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.043533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.071449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 951/1921] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:28.073087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.074828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.075604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.075997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.076351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.077164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.079345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.084787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4fe40-057d-496a-a4d7-e4291e118ef1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.089596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.090289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.090569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.090844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.091805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.093587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.109514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 952/1922] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:28.115564 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.135108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686023-6abe-48b5-bd95-a131677d3281 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.144201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.147528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 971/1923] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:27 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:28.150708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.150927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.151220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.152104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.152356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.155131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.181458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 953/1924] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:28.183204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.202089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c3f36-43c7-4c23-bfd1-d5fc377ce078 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.254889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d888-f15d-43fa-9f44-e2cb556684f7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.272937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.273686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.274328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.274328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.274939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.276989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.311794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 972/1925] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:28 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:28.315850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.329106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1ab81-b83f-41ca-b25f-eb84b04cbf49 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.334559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.335660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.336228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.336671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.337618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.339418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.339603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.340805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.341438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.341732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] PATH_INFO: `/v3/projects/77ba8e20a5b94551a631dff6825a00bb/users/c8604f4ab488461287c0a52dd17934cb/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.352811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 973/1926] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:28.356995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.369573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36d72-e328-4755-8a39-e89975301f90 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.374004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ba8e20a5b94551a631dff6825a00bb, user_id=c8604f4ab488461287c0a52dd17934cb, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.376753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ed5e-ad16-4681-82aa-746b1fe47850 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.378846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.379608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.380587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.381015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.383708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.387945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.401756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 954/1927] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:28 2022] PUT /identity/v3/projects/77ba8e20a5b94551a631dff6825a00bb/users/c8604f4ab488461287c0a52dd17934cb/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:28.409234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 974/1928] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:28.414124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.415248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.416245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.416767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.428545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53fd0-8502-40e4-b905-1a1387a65fff admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.450713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] MFA Rules not processed for user `c8604f4ab488461287c0a52dd17934cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:28.452600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:28.497987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.498899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.499184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.499462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] PATH_INFO: `/v3/projects/fd2bce9e386643d09d517530dd170b1b/users/f00b8271bd4b404eb1165c1b7dee9ce4/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.514087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2bce9e386643d09d517530dd170b1b, user_id=f00b8271bd4b404eb1165c1b7dee9ce4, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.516805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084c61-6dc6-4044-baeb-56090990b0bf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.520470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 955/1929] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:28.533884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.535307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 975/1930] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:28 2022] PUT /identity/v3/projects/fd2bce9e386643d09d517530dd170b1b/users/f00b8271bd4b404eb1165c1b7dee9ce4/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:28.535435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:28.546491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.546782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.547133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.573058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] MFA Rules not processed for user `f00b8271bd4b404eb1165c1b7dee9ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:28.574267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:28.590044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601754-84c4-4e28-afb6-3bb4530c5734 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.636490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 976/1931] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:28.640309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.640853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.641000 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.641282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.641555 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.699614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.701346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.705751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69f4c0-0014-4d6a-a0ac-42a64825ceab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.710657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 956/1932] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:28.710813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.711432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.711752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.712020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.712738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.714712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.744189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 977/1933] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:28 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:28.748492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.759517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20ed7e-7606-49d1-8f19-e72c086f98c7 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.829540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.830258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.830598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.830932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.831586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.835893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.863223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 957/1934] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:28 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:28.866700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.881023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589311d-c646-4521-a93f-f55f263392e5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.887967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.888983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.889272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.889840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.890739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.892410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.920979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 978/1935] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:28.924989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:28.936119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1df4-7e68-4132-b3ab-c2d1faf5ad06 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:28.945800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:28.946698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:28.947067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:28.947432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] PATH_INFO: `/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4/users/c0505c4edce347919b29e40391e0753b/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:28.978178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae0f47300e54253ab09dbbd2db1fac4, user_id=c0505c4edce347919b29e40391e0753b, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:28.978178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:28.993891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 958/1936] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:28 2022] PUT /identity/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4/users/c0505c4edce347919b29e40391e0753b/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:28.998179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:29.015344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c602-b26e-4f6f-9c1d-6503164e143e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:29.116029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:29.117208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:29.117648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:29.118101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:29.119185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:29.121007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9faec-2f29-4192-9213-ea22dd5d8b43 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:29.132501 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 979/1937] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:29.137040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:29.163642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dfc7-95e2-4804-943f-d9ce853a01d5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:29.175008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:29.176515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:29.176819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:29.177134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] PATH_INFO: `/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4/users/c0505c4edce347919b29e40391e0753b/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:29.179490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae0f47300e54253ab09dbbd2db1fac4, user_id=c0505c4edce347919b29e40391e0753b, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:29.182509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:29.197967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 959/1938] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:29 2022] PUT /identity/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4/users/c0505c4edce347919b29e40391e0753b/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:29.208583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:29.208863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:29.209078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:29.260829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] MFA Rules not processed for user `c0505c4edce347919b29e40391e0753b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:29.263970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:29.340985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 980/1939] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:29.352730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:29.407036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81faa9d-2162-48ad-a6d3-268936683805 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:29.410936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:29.411590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:29.411898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:29.412168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:29.423325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:29.424815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dd0e8-27e7-4ed4-a648-6ceb4a4d1143 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:29.435063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 960/1940] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:31.025167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:31.097085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72a93e-a943-4f89-b6f6-f7688abda788 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:31.102395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:31.103742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:31.104423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:31.104896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] PATH_INFO: `/v3/users/f00b8271bd4b404eb1165c1b7dee9ce4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:31.106609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00b8271bd4b404eb1165c1b7dee9ce4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:31.109043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:31.163816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00b8271bd4b404eb1165c1b7dee9ce4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:31.178011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00b8271bd4b404eb1165c1b7dee9ce4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:31.186038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00b8271bd4b404eb1165c1b7dee9ce4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:31.186786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00b8271bd4b404eb1165c1b7dee9ce4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:31.196412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00b8271bd4b404eb1165c1b7dee9ce4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:31.202976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 981/1941] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:31 2022] DELETE /identity/v3/users/f00b8271bd4b404eb1165c1b7dee9ce4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:31.207806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:31.208293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:31.208458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:31.227322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:31.228594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:31.289714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 961/1942] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:31.299729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:31.301283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:31.379325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782195-ed2d-49c4-bca5-d1931cdc301e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:31.406398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:31.408149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:31.408426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:31.408682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:31.423985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:31.425873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:31.436994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 982/1943] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:31.985317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:31.986861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:32.004800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6889b-5416-48cf-9a6d-4c4db9bf3210 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:32.010747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:32.011929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.012387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.013042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] PATH_INFO: `/v3/projects/fd2bce9e386643d09d517530dd170b1b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.027148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2bce9e386643d09d517530dd170b1b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:32.031276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:32.094582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2bce9e386643d09d517530dd170b1b', 'request_id': 'req-f441572e-8fab-4562-b749-4c8d57e38a11'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.101462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2bce9e386643d09d517530dd170b1b', 'request_id': 'req-f441572e-8fab-4562-b749-4c8d57e38a11'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.111077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2bce9e386643d09d517530dd170b1b', 'request_id': 'req-f441572e-8fab-4562-b749-4c8d57e38a11'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.123905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] The token cache is being invalidate because project fd2bce9e386643d09d517530dd170b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:32.124368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.125021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.126563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 962/1944] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:31 2022] DELETE /identity/v3/projects/fd2bce9e386643d09d517530dd170b1b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:32.130603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:32.141437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4bbc3-a9b9-478c-ae84-daf5909b2c0f service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:32.216908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:32.218073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.218542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.218997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] PATH_INFO: `/v3/users/c0505c4edce347919b29e40391e0753b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.220462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0505c4edce347919b29e40391e0753b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:32.223093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:32.230758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:32.233643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:32.247290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441572e-8fab-4562-b749-4c8d57e38a11 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:32.252089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:32.253498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.253807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.254086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] PATH_INFO: `/v3/users/c8604f4ab488461287c0a52dd17934cb` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.255423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8604f4ab488461287c0a52dd17934cb)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:32.257418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:32.278442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0505c4edce347919b29e40391e0753b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.296463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0505c4edce347919b29e40391e0753b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.317433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0505c4edce347919b29e40391e0753b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.318185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0505c4edce347919b29e40391e0753b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.327530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8604f4ab488461287c0a52dd17934cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.336294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8264291-5467-4a31-8687-7a5f22e993bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0505c4edce347919b29e40391e0753b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.343948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 983/1945] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:32 2022] DELETE /identity/v3/users/c0505c4edce347919b29e40391e0753b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:32.344305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8604f4ab488461287c0a52dd17934cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.360994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8604f4ab488461287c0a52dd17934cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.362469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8604f4ab488461287c0a52dd17934cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.375015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8604f4ab488461287c0a52dd17934cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:32.390626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 963/1946] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:32 2022] DELETE /identity/v3/users/c8604f4ab488461287c0a52dd17934cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:32.395870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.396645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.396645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.429320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:32.430744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:32.527723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 984/1947] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:32.536721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:32.538154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:32.609087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254290c0-2c03-4f91-b9f9-1b752bed1e17 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:32.613596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:32.614673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.616211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.616211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.626127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:32.627762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99d3b4-4299-48ca-a68f-506c6d319fa8 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:32.638613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 964/1948] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:32.929192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:32.932232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:32.954558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656911-2b9b-4e0b-ab19-0a717db93679 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:32.964641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:32.969328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:32.969619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:32.969904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] PATH_INFO: `/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:32.973228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae0f47300e54253ab09dbbd2db1fac4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:32.975609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.066678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae0f47300e54253ab09dbbd2db1fac4', 'request_id': 'req-47dfd1d5-d0c2-43d1-819f-f57e4233265f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.075661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae0f47300e54253ab09dbbd2db1fac4', 'request_id': 'req-47dfd1d5-d0c2-43d1-819f-f57e4233265f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.088269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae0f47300e54253ab09dbbd2db1fac4', 'request_id': 'req-47dfd1d5-d0c2-43d1-819f-f57e4233265f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.103265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] The token cache is being invalidate because project 6ae0f47300e54253ab09dbbd2db1fac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:33.103557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.104262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.105989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 985/1949] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:32 2022] DELETE /identity/v3/projects/6ae0f47300e54253ab09dbbd2db1fac4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:33.111966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7fb12-3605-4dd3-8ac5-70945ccc930b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.112258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7fb12-3605-4dd3-8ac5-70945ccc930b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.112533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7fb12-3605-4dd3-8ac5-70945ccc930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.137056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d3b7fb12-3605-4dd3-8ac5-70945ccc930b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:33.138199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d3b7fb12-3605-4dd3-8ac5-70945ccc930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.235102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.237233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.258956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 965/1950] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:33.279980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.280263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.282132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.321336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:33.322903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.324275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd1d5-d0c2-43d1-819f-f57e4233265f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.329906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.331423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.331917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.332202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] PATH_INFO: `/v3/projects/77ba8e20a5b94551a631dff6825a00bb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.334081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ba8e20a5b94551a631dff6825a00bb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.334642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 966/1951] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:33.337511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.340080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.349979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9c60-8f8f-41de-acad-bdd147724e5c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.354851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.355759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.356181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.356618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.357495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:33.357963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.359931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.374655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 967/1952] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:38:33.379411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.390655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b87e2-0228-471b-885c-0791d2caf8c8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.396904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ba8e20a5b94551a631dff6825a00bb', 'request_id': 'req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.404229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ba8e20a5b94551a631dff6825a00bb', 'request_id': 'req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.416213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ba8e20a5b94551a631dff6825a00bb', 'request_id': 'req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.430769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] The token cache is being invalidate because project 77ba8e20a5b94551a631dff6825a00bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:33.431114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.432459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ddaafc8f-669e-4a34-bc91-9ec07c37ed44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:33.434550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 986/1953] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:33 2022] DELETE /identity/v3/projects/77ba8e20a5b94551a631dff6825a00bb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:33.440230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc94e-3b63-469e-a05d-cf82fa6c0b9f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.440806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc94e-3b63-469e-a05d-cf82fa6c0b9f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.441161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc94e-3b63-469e-a05d-cf82fa6c0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.461811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-082dc94e-3b63-469e-a05d-cf82fa6c0b9f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:33.464071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-082dc94e-3b63-469e-a05d-cf82fa6c0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.464296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.465015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.465305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.465583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.466291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.468326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.487915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 987/1954] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:33.492872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.493151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.493423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.502743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 968/1955] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:33.503644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.505757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.521064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:33.522332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.571327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0505-8631-401e-9352-48dc7dac28c1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.576292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.577241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.577525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.577803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.578532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.580641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.585236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 988/1956] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:33.589394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.598877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41453c2-c45d-4e7d-b3bc-b4c0825e3f17 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.602492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 969/1957] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:33.603860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.604602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.604885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.605155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.606043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:33.606545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.606920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.608364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.617226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac699-eae1-498c-82ba-b451a0a519eb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.621385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 989/1958] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:38:33.625508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.625734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.626279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.626563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.626845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.627719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.630204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.636585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c201c-9cbf-43c5-8f49-3f2dbc1e8bbf admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.640786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 970/1959] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:33.644955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.645119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.645646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.645928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.646203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.646928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.648947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.656943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5c187-667f-4a8e-ac7d-adb239034003 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.662586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.663289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.663590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.663903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.664646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.666291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.678969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 971/1960] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:33.682927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.683341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 990/1961] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:33.684257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.694254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cf39e-81e4-4a11-b1a9-89bd6af20c3f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.753612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.754522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.754804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.755082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] PATH_INFO: `/v3/projects/70f9692b74b3466890a51ca90bf9c953/users/922ec0c5bda74d69886b3d1a378b3474/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.766319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5b244-5016-4616-98dc-4839b58ed028 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.771003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9692b74b3466890a51ca90bf9c953, user_id=922ec0c5bda74d69886b3d1a378b3474, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.772494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.773257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.773615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.773728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039cf4c-357b-463c-a8f0-4ba6140ac7e5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.773982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.774745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.776888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.789373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 972/1962] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:33 2022] PUT /identity/v3/projects/70f9692b74b3466890a51ca90bf9c953/users/922ec0c5bda74d69886b3d1a378b3474/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:33.795349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.795732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.796015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.803500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 991/1963] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:33.805317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.816540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:33.817147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fa0f2-c26b-4267-8e5e-87d21a6f95b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.817928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.881100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 973/1964] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:33.885203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.885969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.886319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.886673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.887505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.889200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.891161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.892775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:33.899836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 992/1965] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:33.903769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.913637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f9566-ee31-4bd6-a2af-3d44d066859d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.919368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.920504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.920852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.921191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.922003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.924087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.934473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 993/1966] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:33.938473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:33.948320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb77ee-fcda-4109-b093-1c90172ecb04 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.953898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.955000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.955328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.955628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] PATH_INFO: `/v3/projects/504610e78fc74e32b94f0c049282bb16/users/81b483283ebd4e22928f50e002788688/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.961649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea35f2-fe7d-40c3-8cc3-fd043de55297 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:33.965731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:33.966412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:33.966693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:33.966970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:33.974226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504610e78fc74e32b94f0c049282bb16, user_id=81b483283ebd4e22928f50e002788688, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.977014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:33.977538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.978449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e34d-5bb3-4dd2-b8af-6983c9788227 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:33.988830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 974/1967] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:33.994029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 994/1968] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:33 2022] PUT /identity/v3/projects/504610e78fc74e32b94f0c049282bb16/users/81b483283ebd4e22928f50e002788688/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:34.005205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b7b7-7937-4713-b597-cdea264802a0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:34.005496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b7b7-7937-4713-b597-cdea264802a0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:34.005894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b7b7-7937-4713-b597-cdea264802a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:34.046201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7ff7b7b7-7937-4713-b597-cdea264802a0 None None] MFA Rules not processed for user `81b483283ebd4e22928f50e002788688`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:34.047915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7ff7b7b7-7937-4713-b597-cdea264802a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:34.186377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 975/1969] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:34.200982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:34.203798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:34.334728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d810c-adce-4b41-8eb8-791a4956bc38 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:34.341461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:34.342854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:34.343444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:34.343899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:34.364645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:34.364645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:34.385284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 995/1970] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:35.072070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.072596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.072691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.100294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] MFA Rules not processed for user `922ec0c5bda74d69886b3d1a378b3474`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:35.101505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:35.165482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 976/1971] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:35.170333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.236865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d161-164b-44f8-8be1-50e0762bb64c service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.243300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.244024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.244311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.244589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.245308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.247241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.280836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 996/1972] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:35 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:35.282143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.293334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7293-a44e-4449-93a1-a575251b1011 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.356565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.357456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.357704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.357987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.358744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.360803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.396532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 977/1973] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:35 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:35.400723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.411818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021009b4-a10b-4e4e-af14-1396d55c2de7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.416781 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.417685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.417973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.418255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.419005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.420991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.432498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 997/1974] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:35.436851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.447407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59373ed3-452b-4ffb-82ec-8ea17eadd119 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.452157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.453091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.453376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.453656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] PATH_INFO: `/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022/users/18c901623ce84a5da9d809c07d22cb35/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.469733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df97e39b9bf940d5a2a0b0c8897d0022, user_id=18c901623ce84a5da9d809c07d22cb35, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.472559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.487811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 978/1975] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:35 2022] PUT /identity/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022/users/18c901623ce84a5da9d809c07d22cb35/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:35.491995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.502427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca500-f0d6-4cc1-89ff-c42be13a6e89 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.598572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.599288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.599601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.599922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.600720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.602429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d638f-6746-48d5-8158-ca3567dda6d9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.614370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 998/1976] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:35.619069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:35.630566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f7d0-a657-431e-be69-0d4aafc64f22 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:35.636807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:35.637770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:35.638075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:35.638396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] PATH_INFO: `/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022/users/18c901623ce84a5da9d809c07d22cb35/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:35.640721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df97e39b9bf940d5a2a0b0c8897d0022, user_id=18c901623ce84a5da9d809c07d22cb35, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:35.643832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:35.659650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 979/1977] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:35 2022] PUT /identity/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022/users/18c901623ce84a5da9d809c07d22cb35/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:36.415641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:36.416526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:36.416989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:36.448734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] MFA Rules not processed for user `18c901623ce84a5da9d809c07d22cb35`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:36.449948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:36.519297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 999/1978] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:36.530963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:36.533479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:36.590586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2531fa-065d-4b2c-a2e1-0ff825a6ac4f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:36.594198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:36.594857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:36.595137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:36.595409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:36.668563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:36.670530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:36.680014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 980/1979] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:38.038300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:38.051795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3dad6-6fa7-4cac-aa6a-e42ac2ee60e3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:38.055453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:38.056147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:38.056429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:38.056730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:38.066648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:38.068624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:38.078992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1000/1980] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:55.783627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:55.866724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd8fa2-4733-4b69-addb-1a489201dc32 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:55.871384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:55.872494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:55.873238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:55.873594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] PATH_INFO: `/v3/users/922ec0c5bda74d69886b3d1a378b3474` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:55.875156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922ec0c5bda74d69886b3d1a378b3474)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:55.877502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:55.928417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922ec0c5bda74d69886b3d1a378b3474'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:55.941959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922ec0c5bda74d69886b3d1a378b3474'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:55.943105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922ec0c5bda74d69886b3d1a378b3474'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:55.944074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922ec0c5bda74d69886b3d1a378b3474'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:55.953089 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922ec0c5bda74d69886b3d1a378b3474'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:55.965917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 981/1981] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:55 2022] DELETE /identity/v3/users/922ec0c5bda74d69886b3d1a378b3474 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:56.142553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:56.163535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518caed-c5b2-4e2c-9cd2-7384c1b4677d service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:56.222633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:56.223536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:56.223833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:56.224109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] PATH_INFO: `/v3/projects/70f9692b74b3466890a51ca90bf9c953` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:56.225460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9692b74b3466890a51ca90bf9c953)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:56.227350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:56.278198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9692b74b3466890a51ca90bf9c953', 'request_id': 'req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.283905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9692b74b3466890a51ca90bf9c953', 'request_id': 'req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.292410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9692b74b3466890a51ca90bf9c953', 'request_id': 'req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.305121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] The token cache is being invalidate because project 70f9692b74b3466890a51ca90bf9c953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:56.305418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.306146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.308140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1001/1982] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:56 2022] DELETE /identity/v3/projects/70f9692b74b3466890a51ca90bf9c953 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:56.312001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:56.313682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:56.329679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fc8e4-d6bc-488a-9e43-dbc0c7ca7688 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:56.340444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:56.344218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:56.398933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:56.399937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:56.400222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:56.400829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] PATH_INFO: `/v3/users/18c901623ce84a5da9d809c07d22cb35` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:56.402060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c901623ce84a5da9d809c07d22cb35)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:56.404102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:56.425016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3aa75-c423-49fc-8391-8d6db1b3dbb1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:56.430711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:56.431875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:56.432262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:56.432639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] PATH_INFO: `/v3/users/6f801c74ab294ea98c631aa74aed8f07` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:56.434028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f801c74ab294ea98c631aa74aed8f07)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:56.436476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:56.474310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c901623ce84a5da9d809c07d22cb35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.490329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c901623ce84a5da9d809c07d22cb35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.491257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c901623ce84a5da9d809c07d22cb35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.492012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c901623ce84a5da9d809c07d22cb35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.495314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f801c74ab294ea98c631aa74aed8f07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.503244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c901623ce84a5da9d809c07d22cb35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.510469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f801c74ab294ea98c631aa74aed8f07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.520054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 982/1983] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:56 2022] DELETE /identity/v3/users/18c901623ce84a5da9d809c07d22cb35 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:56.529299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f801c74ab294ea98c631aa74aed8f07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.530201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f801c74ab294ea98c631aa74aed8f07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.550706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f801c74ab294ea98c631aa74aed8f07'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.566972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1002/1984] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:38:56 2022] DELETE /identity/v3/users/6f801c74ab294ea98c631aa74aed8f07 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:56.778331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:56.779870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:56.853879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:56.856688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:56.872005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c85be-38a2-413b-9313-c512c91e30af admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:56.926223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2779-f71d-407d-a0c1-4554e4023f0c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:56.931388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:56.931745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:56.932314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:56.932600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:56.932694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:56.932900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:56.933028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] PATH_INFO: `/v3/projects/c865b8a441ac423e9032a0c70301ec6e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:56.933168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] PATH_INFO: `/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:56.934114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c865b8a441ac423e9032a0c70301ec6e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:56.934331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=df97e39b9bf940d5a2a0b0c8897d0022)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:56.936293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:56.936419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:56.986602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c865b8a441ac423e9032a0c70301ec6e', 'request_id': 'req-03dbb3bf-cebe-400c-9b19-65df8035910d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.988966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df97e39b9bf940d5a2a0b0c8897d0022', 'request_id': 'req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.996290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df97e39b9bf940d5a2a0b0c8897d0022', 'request_id': 'req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:56.997076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c865b8a441ac423e9032a0c70301ec6e', 'request_id': 'req-03dbb3bf-cebe-400c-9b19-65df8035910d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.005873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c865b8a441ac423e9032a0c70301ec6e', 'request_id': 'req-03dbb3bf-cebe-400c-9b19-65df8035910d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.009752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df97e39b9bf940d5a2a0b0c8897d0022', 'request_id': 'req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.019286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] The token cache is being invalidate because project c865b8a441ac423e9032a0c70301ec6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:57.019580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.020326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-03dbb3bf-cebe-400c-9b19-65df8035910d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.022155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1003/1985] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:56 2022] DELETE /identity/v3/projects/c865b8a441ac423e9032a0c70301ec6e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:57.023075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] The token cache is being invalidate because project df97e39b9bf940d5a2a0b0c8897d0022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:38:57.023373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.024042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d40549a2-c8b6-4894-9a09-8f0f2068fb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:38:57.025881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 983/1986] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:38:56 2022] DELETE /identity/v3/projects/df97e39b9bf940d5a2a0b0c8897d0022 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:57.028001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea36aa-9913-4630-9f5c-99b70c181bd5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.028487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea36aa-9913-4630-9f5c-99b70c181bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.028666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea36aa-9913-4630-9f5c-99b70c181bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.030812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718eb9-56bf-4d3c-82a9-4c6b3f564b6f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.031104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718eb9-56bf-4d3c-82a9-4c6b3f564b6f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.031484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f718eb9-56bf-4d3c-82a9-4c6b3f564b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.050386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-25ea36aa-9913-4630-9f5c-99b70c181bd5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.051782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-25ea36aa-9913-4630-9f5c-99b70c181bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.054634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1f718eb9-56bf-4d3c-82a9-4c6b3f564b6f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.055827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1f718eb9-56bf-4d3c-82a9-4c6b3f564b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.123733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1004/1987] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:57.124528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 984/1988] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:57.129494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.129779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.130144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.132194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.132574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.132888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.151429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.152121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.152712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.153363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.163303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1005/1989] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:57.163841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 985/1990] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:57.167720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.167899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.179041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a764-32dc-4879-9b3f-bb74957fede7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.179259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09afb75-2c3a-44fb-8f89-2da13ad37f67 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.183795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.184130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.184488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.184772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.184885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.185053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.185184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.185338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.185884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:57.186057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:38:57.186234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.186718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.187893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.188533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.203401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 986/1991] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:57.204410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.204873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1006/1992] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:38:57.205678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.214791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92523c8-a585-4bc7-bb3c-3cd82b8917f5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.215120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4b7e-0c5e-4e25-9e5e-53cc8de67345 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.219419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.219652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.220116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.220331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.220429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.220619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.220716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.220899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.221357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.221582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.223269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.223738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.252296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 987/1993] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.256165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1007/1994] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.256683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.260008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.317607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c9a97-4854-4f34-9aa0-25e3c409f912 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.322563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.323252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.323531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.323836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.324540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.326456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95b41-f545-45ef-a115-5ad8b9ba5c51 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.326569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.331262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.331960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.332241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.332514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.333243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.335605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.349056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 988/1995] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.353443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.359385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1008/1996] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.360355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.363506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a756-8624-4a9b-96c3-df6b45951f2d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.368360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.369044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.369323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.369599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.369797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31abe3-82af-46d6-8256-32e228bacb89 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.370336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.372018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.374536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.375207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.375492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.375810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.376571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.378172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.382298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 989/1997] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:57.386330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.393726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1009/1998] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:57.397858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.399477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dfcf6-3a46-4465-968b-8917ff5ab259 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.404750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.405482 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.405715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.405993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.406750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.408417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.409237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f9c0-7102-49ad-a340-ee042944c967 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.414788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.415544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.415915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.416277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.417089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.418757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.421624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 990/1999] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:57.428140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.440544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1010/2000] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:57.440692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1ff6-ac4c-420a-9724-c13595c692e1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.444850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.446995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.447978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.448258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.448529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] PATH_INFO: `/v3/projects/e642cd4293294b49b1fb5c475e02a062/users/1b88541cd47644ea8ecdcac8a790a2a3/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.455770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba112e-0efa-4f45-87d4-8ea77e58e98c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.463056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.463056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.463056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.463400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] PATH_INFO: `/v3/projects/955bea5ccc564b7f8cd5c83c3a21e41b/users/6f48965567214cb0bb953231f8af1254/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.465449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e642cd4293294b49b1fb5c475e02a062, user_id=1b88541cd47644ea8ecdcac8a790a2a3, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.468234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73de5e-cd42-44b6-9275-bee50362a054 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.478929 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955bea5ccc564b7f8cd5c83c3a21e41b, user_id=6f48965567214cb0bb953231f8af1254, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.481748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6860f0-186b-4847-8877-3472b2efd9a6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.484007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 991/2001] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:57 2022] PUT /identity/v3/projects/e642cd4293294b49b1fb5c475e02a062/users/1b88541cd47644ea8ecdcac8a790a2a3/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:57.495191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.495595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.495831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.500853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1011/2002] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:57 2022] PUT /identity/v3/projects/955bea5ccc564b7f8cd5c83c3a21e41b/users/6f48965567214cb0bb953231f8af1254/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:57.513073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.513424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.513627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.525882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] MFA Rules not processed for user `1b88541cd47644ea8ecdcac8a790a2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.527744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.547812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] MFA Rules not processed for user `6f48965567214cb0bb953231f8af1254`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:57.549098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:57.625044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 992/2003] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:57.629541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.630077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1012/2004] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:57.634840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.711611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65875e0-d75e-49ef-a377-f2fee4e73f27 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.716603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.717374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.717724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.718069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.719349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.723610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.724298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c316bf6-db48-43bd-a62c-8b428850c4ae None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.729470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.730260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.730607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.730976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.731816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.733824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.756882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 993/2005] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.761484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.767936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1013/2006] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.772151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.827680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839768e-34ec-4b5c-9ce8-e7aa8ddb8a3f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.858044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c3da1-052c-45a9-864c-0ea2f467f4c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.869911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.870797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.871169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.871534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.872358 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.874401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.898381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1014/2007] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:57.901944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.903589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.904380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.904662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.904931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.905676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.907657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.912930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45664-5388-47fb-922b-9e0503d86cdd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.917539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.918219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.918502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.918843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.919987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.921826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.936822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1015/2008] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:57.937014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 994/2009] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:57 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:57.937774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.939469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.949716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688473b-b40a-43ee-9a2a-447be3771562 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.950588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e3ae-cf7d-43db-920d-02297624c614 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:57.954997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.955844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.956190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.956531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.956665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:57.957346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.957459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:57.957816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:57.957977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] PATH_INFO: `/v3/projects/97ca6f14bcc64fa6935d7e977c42b652/users/7eb368b184324f3cb2a337719ee3329a/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:57.961118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.978079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ca6f14bcc64fa6935d7e977c42b652, user_id=7eb368b184324f3cb2a337719ee3329a, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:57.980354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1016/2010] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:57.983993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:57.984370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:57.997289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92602-5efa-421f-af7d-19e48fe45185 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.005827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 995/2011] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:57 2022] PUT /identity/v3/projects/97ca6f14bcc64fa6935d7e977c42b652/users/7eb368b184324f3cb2a337719ee3329a/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:58.010145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.060505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.061193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.061477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.061756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.062489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.064159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.074288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1017/2012] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:58.079274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.081577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a17f-9c42-49fa-a67f-806d3f9644e1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.087107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.087893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.088294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.088576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.089049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c68af7-bf8b-4f63-aca4-c2a10bad92b3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.089310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.090930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.093765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.094644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.094927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.095205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] PATH_INFO: `/v3/projects/c14143cc9dea4841b8513863ffb11850/users/129815894d6141bead498fc71179bdb9/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.101126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 996/2013] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:58.105324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.112674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14143cc9dea4841b8513863ffb11850, user_id=129815894d6141bead498fc71179bdb9, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.115486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acdeef-2ef1-4f69-8eed-4fff403fc7dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.115644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af26d-375a-47f2-b03f-77df68bfe731 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.127909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.127909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.127909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.127909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] PATH_INFO: `/v3/projects/97ca6f14bcc64fa6935d7e977c42b652/users/7eb368b184324f3cb2a337719ee3329a/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.128569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ca6f14bcc64fa6935d7e977c42b652, user_id=7eb368b184324f3cb2a337719ee3329a, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.128569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c480fa-7582-4992-a578-4f5867a4e046 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.140121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 997/2014] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:58 2022] PUT /identity/v3/projects/97ca6f14bcc64fa6935d7e977c42b652/users/7eb368b184324f3cb2a337719ee3329a/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:58.149330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1018/2015] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:58 2022] PUT /identity/v3/projects/c14143cc9dea4841b8513863ffb11850/users/129815894d6141bead498fc71179bdb9/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:58.151777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.152072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.152401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.153173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.153633 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.153760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.180213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] MFA Rules not processed for user `129815894d6141bead498fc71179bdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:58.180431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] MFA Rules not processed for user `7eb368b184324f3cb2a337719ee3329a`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:58.181430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:58.181607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:58.244270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1019/2016] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:38:58.246782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 998/2017] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:58.248485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.258480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.260232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:58.316223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c444dc-fe2a-4ff9-a5d4-e73c47a8d966 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.318107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3566f-fd22-4b73-8fc7-02d950aa66b5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.320354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.321052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.321493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.321769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.323254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.323963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.324252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.324533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.325266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.327283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.332098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.333584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.344602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 999/2018] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:38:58.371724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1020/2019] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:38:58 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:38:58.374583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.391539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa29e9b-2f65-4abc-af35-6f946403d24a service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.425329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.453521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.454336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.454652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.454880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.455583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.457549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.483890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1000/2020] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:38:58 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:38:58.485009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.493038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef90c-36e3-429d-84cf-76059da97b2a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.496045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c6a9-fc59-4de2-a113-c58810188326 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.496863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.497539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.497846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.498126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.501174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.501849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.502131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.502406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.503138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.504907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.515074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1001/2021] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:38:58.519192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.529016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e36c-6abe-4ca9-a2bd-c2559908cdf5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.533874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.534784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.535066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.535341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] PATH_INFO: `/v3/projects/103e3cf715f545df89deaf127340f7b6/users/89653995796745ba9e34ed759d697298/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.551011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103e3cf715f545df89deaf127340f7b6, user_id=89653995796745ba9e34ed759d697298, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.553853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.555484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.557020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.566593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1021/2022] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:58.567490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1002/2023] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:58 2022] PUT /identity/v3/projects/103e3cf715f545df89deaf127340f7b6/users/89653995796745ba9e34ed759d697298/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:38:58.571516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.581907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709397fe-1743-420c-82c0-b7a08375db23 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.645227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.645922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.646207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.646786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.647911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.649877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f251-b145-4854-b5c4-3d54d2aea3c7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.660960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1022/2024] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:38:58.664969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.687627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b01e-6aa1-4bfa-a005-a99343c9d532 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.695828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.696879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.697259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.697570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] PATH_INFO: `/v3/projects/103e3cf715f545df89deaf127340f7b6/users/89653995796745ba9e34ed759d697298/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.699868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103e3cf715f545df89deaf127340f7b6, user_id=89653995796745ba9e34ed759d697298, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.702678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.714261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1003/2025] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:38:58 2022] PUT /identity/v3/projects/103e3cf715f545df89deaf127340f7b6/users/89653995796745ba9e34ed759d697298/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:38:58.725890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.726443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.726863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.760375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] MFA Rules not processed for user `89653995796745ba9e34ed759d697298`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:58.761641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:58.834693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1023/2026] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:58.846404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:58.902228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4545c-9fb8-4578-885c-cad24160a552 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:58.905940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:58.906562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:58.906862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:58.907139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:58.976272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:58.977793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:58.987519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1004/2027] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:00.526585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:00.536072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8526-224f-417a-aa9f-6163e8cd695e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:00.540485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:00.541163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:00.541445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:00.541717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:00.605241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:00.606702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:00.615949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1024/2028] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:01.222363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:01.223897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:01.235794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a539cfc-c085-4df1-bbd8-8c29ab76c09c service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:01.239561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:01.240318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:01.240731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:01.241422 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:01.250248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:01.251778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f378-3a0a-44d5-aa1e-77d1e3bc7cc9 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:01.262797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1005/2029] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:01.351125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:01.415093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912a912-7b9a-47fa-b322-0075c30e2d4f service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:01.420386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:01.421288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:01.421579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:01.421861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] PATH_INFO: `/v3/users/6f48965567214cb0bb953231f8af1254` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:01.423108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f48965567214cb0bb953231f8af1254)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:01.425159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:01.483543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f48965567214cb0bb953231f8af1254'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:01.495319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f48965567214cb0bb953231f8af1254'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:01.502276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f48965567214cb0bb953231f8af1254'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:01.503043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f48965567214cb0bb953231f8af1254'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:01.513746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f48965567214cb0bb953231f8af1254'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:01.520467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1025/2030] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:01 2022] DELETE /identity/v3/users/6f48965567214cb0bb953231f8af1254 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:01.526229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:01.526559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:01.526791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:01.546391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:01.547735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:01.609375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1006/2031] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:01.619657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:01.627568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:01.687807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f21c45-feb0-4b08-a804-c5dfdcba9999 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:01.692101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:01.692767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:01.693051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:01.693329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:01.703085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:01.704604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:01.715107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1026/2032] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:02.017264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:02.018809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:02.035947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ce8f-8307-47d5-8516-3503e7012722 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:02.041865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:02.043064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.043451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.043876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] PATH_INFO: `/v3/projects/955bea5ccc564b7f8cd5c83c3a21e41b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.045572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955bea5ccc564b7f8cd5c83c3a21e41b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:02.047568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:02.096598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955bea5ccc564b7f8cd5c83c3a21e41b', 'request_id': 'req-45d28148-cb8c-4b28-8932-dc2addd40b12'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.101858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955bea5ccc564b7f8cd5c83c3a21e41b', 'request_id': 'req-45d28148-cb8c-4b28-8932-dc2addd40b12'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.110636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955bea5ccc564b7f8cd5c83c3a21e41b', 'request_id': 'req-45d28148-cb8c-4b28-8932-dc2addd40b12'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.121870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] The token cache is being invalidate because project 955bea5ccc564b7f8cd5c83c3a21e41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:02.122147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.122813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.124556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1007/2033] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:02 2022] DELETE /identity/v3/projects/955bea5ccc564b7f8cd5c83c3a21e41b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:02.128675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:02.139078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e055-afb3-4ff2-afb3-bdd26d124674 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:02.202162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:02.203071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.203354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.203627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] PATH_INFO: `/v3/users/7eb368b184324f3cb2a337719ee3329a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.204899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb368b184324f3cb2a337719ee3329a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:02.206847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:02.254019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb368b184324f3cb2a337719ee3329a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.266928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb368b184324f3cb2a337719ee3329a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.274014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb368b184324f3cb2a337719ee3329a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.274783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb368b184324f3cb2a337719ee3329a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.283056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-c5798cb6-be49-447f-b900-717b6dcc4f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb368b184324f3cb2a337719ee3329a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.289156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1027/2034] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:02 2022] DELETE /identity/v3/users/7eb368b184324f3cb2a337719ee3329a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:02.580079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:02.582305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:02.602511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28148-cb8c-4b28-8932-dc2addd40b12 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:02.679572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:02.680701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.681236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.681666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] PATH_INFO: `/v3/projects/97ca6f14bcc64fa6935d7e977c42b652` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.683048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ca6f14bcc64fa6935d7e977c42b652)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:02.686037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:02.718729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac81f9-f850-4000-8937-c89162375119 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.719966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac81f9-f850-4000-8937-c89162375119 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.720613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac81f9-f850-4000-8937-c89162375119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.746344 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6dac81f9-f850-4000-8937-c89162375119 None None] MFA Rules not processed for user `35fc8699f921492282b5be9b5fab5b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:02.748137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6dac81f9-f850-4000-8937-c89162375119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:02.767893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ca6f14bcc64fa6935d7e977c42b652', 'request_id': 'req-3658980d-6a9d-49e1-873a-c85df46a18b7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.784831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ca6f14bcc64fa6935d7e977c42b652', 'request_id': 'req-3658980d-6a9d-49e1-873a-c85df46a18b7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.795632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ca6f14bcc64fa6935d7e977c42b652', 'request_id': 'req-3658980d-6a9d-49e1-873a-c85df46a18b7'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.808203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] The token cache is being invalidate because project 97ca6f14bcc64fa6935d7e977c42b652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:02.808494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.809145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-3658980d-6a9d-49e1-873a-c85df46a18b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:02.810734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1008/2035] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:02 2022] DELETE /identity/v3/projects/97ca6f14bcc64fa6935d7e977c42b652 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:02.815462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.815785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.819807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.824838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1028/2036] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:02.851639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:02.853584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:02.920833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1009/2037] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:02.928822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498093d-9445-4d68-8410-89d883d49743 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.929103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498093d-9445-4d68-8410-89d883d49743 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.929379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498093d-9445-4d68-8410-89d883d49743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.947525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8498093d-9445-4d68-8410-89d883d49743 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:02.948954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8498093d-9445-4d68-8410-89d883d49743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:02.956867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1029/2038] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:02.961434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:02.971331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9d9ba-9608-4e91-9ba0-ac7dea9d99d0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:02.976612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:02.977324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:02.977633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:02.977908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:02.979037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:02.979349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:02.981058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:02.993115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1010/2039] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:02.998155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498093d-9445-4d68-8410-89d883d49743 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.007790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498093d-9445-4d68-8410-89d883d49743 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.012429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.013149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.013423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.013695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.014384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.016353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.045736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1030/2040] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:02 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:03.046783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.057521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb707dc-17c5-4fc2-98b6-ded7e460e102 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.130879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.131722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.132019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.132293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.133004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.134997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.163071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1011/2041] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:03 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:03.164718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.176205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c04f-2259-4969-b4c9-b32dfb3baa94 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.181005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.181713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.181971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.182270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.182996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.184631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.196132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1031/2042] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:03.202013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.213537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51487a-ec60-40dc-b43a-ab3b963d30aa admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.219013 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.219750 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.220037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.220313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.221066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.222706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edddf5-2459-48fc-b923-87b60cf5dc19 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.233552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1012/2043] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:39:03.237874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.248293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd01bc-0d37-4491-acbd-ebe505c143a3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.253064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.253939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.254623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.254623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] PATH_INFO: `/v3/projects/8f9cf4d5bc8f42caba177f6c850296ae/users/e5da273bc7ba4f83b1cc3d8bad76dda5/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.270095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9cf4d5bc8f42caba177f6c850296ae, user_id=e5da273bc7ba4f83b1cc3d8bad76dda5, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.273468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.289593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1032/2044] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:03 2022] PUT /identity/v3/projects/8f9cf4d5bc8f42caba177f6c850296ae/users/e5da273bc7ba4f83b1cc3d8bad76dda5/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:03.301354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.301581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.301865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.333124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] MFA Rules not processed for user `e5da273bc7ba4f83b1cc3d8bad76dda5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:03.335744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:03.417652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1013/2045] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:03.422935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.491406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1c224-0f3f-4287-8be6-44d6ad9ca70f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.503771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.504905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.505450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.506092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.507175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.509705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.538122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1033/2046] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:03 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:03.540879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.552337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f732ed-dcd3-4459-abbe-c4896d8eee15 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.610854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.611672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.612266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.612266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.612949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.614876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.635389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1014/2047] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:03 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:03.639108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.650307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4aa-cae0-45cd-a878-ecedf1906038 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.655784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.656468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.656753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.657029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.657876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.659502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.672684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1034/2048] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:03.678026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.689440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f8f8-865f-479a-99d7-82b10947e9d7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.694125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.695044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.695328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.695603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] PATH_INFO: `/v3/projects/2f6cbfc2f12a41949460b32856e179a9/users/1101035bee48437dbed036154de5d833/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.711039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6cbfc2f12a41949460b32856e179a9, user_id=1101035bee48437dbed036154de5d833, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.713815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.729835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1015/2049] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:03 2022] PUT /identity/v3/projects/2f6cbfc2f12a41949460b32856e179a9/users/1101035bee48437dbed036154de5d833/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:03.734299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.746651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393af8-0554-46ba-816e-2d84fad7df66 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.808978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.809597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.809914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.810157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.810893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.812547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43adb-8885-4bc2-909c-cf4161cdc759 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.835728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1035/2050] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:03.841890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:03.862365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f72017-b6e0-4548-a4b4-d84d8431ce19 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:03.868016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:03.868940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.869221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.869502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] PATH_INFO: `/v3/projects/2f6cbfc2f12a41949460b32856e179a9/users/1101035bee48437dbed036154de5d833/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.871563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6cbfc2f12a41949460b32856e179a9, user_id=1101035bee48437dbed036154de5d833, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:03.874268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:03.886748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1016/2051] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:03 2022] PUT /identity/v3/projects/2f6cbfc2f12a41949460b32856e179a9/users/1101035bee48437dbed036154de5d833/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:03.901599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:03.901599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:03.901599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:03.936631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] MFA Rules not processed for user `1101035bee48437dbed036154de5d833`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:03.938317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:04.026824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1036/2052] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:04.038839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:04.040626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:04.110220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08bbb-80a7-4fd2-8b2f-f34a2773a539 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:04.125185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:04.126014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.126414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.126691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.137736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:04.139249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ad59e-20ce-4e32-804d-a07d1acaf782 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:04.150119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1017/2053] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:04.182223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:04.249938 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950055-0370-4f12-9af3-7d11b23a15a8 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:04.254638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:04.255519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.255826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.256659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] PATH_INFO: `/v3/users/e5da273bc7ba4f83b1cc3d8bad76dda5` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.257543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5da273bc7ba4f83b1cc3d8bad76dda5)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:04.259500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:04.311244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5da273bc7ba4f83b1cc3d8bad76dda5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.323862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5da273bc7ba4f83b1cc3d8bad76dda5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.330656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5da273bc7ba4f83b1cc3d8bad76dda5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.331364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5da273bc7ba4f83b1cc3d8bad76dda5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.341188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5da273bc7ba4f83b1cc3d8bad76dda5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.347518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1037/2054] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:04 2022] DELETE /identity/v3/users/e5da273bc7ba4f83b1cc3d8bad76dda5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:04.352703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.353020 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.353303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.372220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:04.373430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:04.448496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1018/2055] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:04.458706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:04.460916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:04.522594 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801667cb-8ee4-4185-8395-2d66aaa2e857 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:04.526376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:04.527038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.527322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.527597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.537029 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:04.538989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:04.550352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1038/2056] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:04.886289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:04.888209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:04.906118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f342a-28ab-4131-8d7f-97968f08a364 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:04.911661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:04.913126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.913415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.913688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] PATH_INFO: `/v3/projects/8f9cf4d5bc8f42caba177f6c850296ae` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.915101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9cf4d5bc8f42caba177f6c850296ae)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:04.917064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:04.966913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9cf4d5bc8f42caba177f6c850296ae', 'request_id': 'req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.972945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9cf4d5bc8f42caba177f6c850296ae', 'request_id': 'req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.983856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9cf4d5bc8f42caba177f6c850296ae', 'request_id': 'req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.997843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] The token cache is being invalidate because project 8f9cf4d5bc8f42caba177f6c850296ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:04.998277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:04.999022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.001251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1019/2057] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:04 2022] DELETE /identity/v3/projects/8f9cf4d5bc8f42caba177f6c850296ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:05.005429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.015605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084342e-1767-40bd-923f-a789a684cebd service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.078882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.079806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.080086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.080360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] PATH_INFO: `/v3/users/1101035bee48437dbed036154de5d833` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.081598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1101035bee48437dbed036154de5d833)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.083532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.131161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1101035bee48437dbed036154de5d833'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.149283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1101035bee48437dbed036154de5d833'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.157476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1101035bee48437dbed036154de5d833'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.158385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1101035bee48437dbed036154de5d833'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.167772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5bf3f6b6-80d5-43e3-894d-5379604fdd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1101035bee48437dbed036154de5d833'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.174467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1039/2058] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:05 2022] DELETE /identity/v3/users/1101035bee48437dbed036154de5d833 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:05.286126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.287627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.305549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960cb5-7eec-41de-b58c-aaab9e6e2ab2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.369944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.370554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.370838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.371110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] PATH_INFO: `/v3/users/1b88541cd47644ea8ecdcac8a790a2a3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.372885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b88541cd47644ea8ecdcac8a790a2a3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.375320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.437693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b88541cd47644ea8ecdcac8a790a2a3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.453589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b88541cd47644ea8ecdcac8a790a2a3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.454608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b88541cd47644ea8ecdcac8a790a2a3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.455272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b88541cd47644ea8ecdcac8a790a2a3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.465785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b88541cd47644ea8ecdcac8a790a2a3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.483734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1020/2059] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:05 2022] DELETE /identity/v3/users/1b88541cd47644ea8ecdcac8a790a2a3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:05.487348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.487746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.488164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.512020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:05.514475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.514911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.517368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.582614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1040/2060] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:05.593122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.594584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.608435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6dec-70d0-47a9-bf16-5e74536dccfc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.613500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.614381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.614665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.614931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] PATH_INFO: `/v3/projects/2f6cbfc2f12a41949460b32856e179a9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.616769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6cbfc2f12a41949460b32856e179a9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.618664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.652951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b3b0e-5206-451b-9d65-f2e52ccc2732 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.656582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.657248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.657522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.657797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.668533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.670642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba3d-3edd-4123-ab82-3cfefbe7a731 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.674350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6cbfc2f12a41949460b32856e179a9', 'request_id': 'req-36f9ea53-d6b7-4417-8dc0-07e55759d83d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.678808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6cbfc2f12a41949460b32856e179a9', 'request_id': 'req-36f9ea53-d6b7-4417-8dc0-07e55759d83d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.681445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1041/2061] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:39:05.699792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6cbfc2f12a41949460b32856e179a9', 'request_id': 'req-36f9ea53-d6b7-4417-8dc0-07e55759d83d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.714704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] The token cache is being invalidate because project 2f6cbfc2f12a41949460b32856e179a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:05.715004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.715868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-36f9ea53-d6b7-4417-8dc0-07e55759d83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:05.717754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1021/2062] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:05 2022] DELETE /identity/v3/projects/2f6cbfc2f12a41949460b32856e179a9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:05.723528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.723859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.724429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.754527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:05.756125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.833616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1042/2063] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:05.841834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.842120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.842398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.863537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:05.865314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:05.878832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1022/2064] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:05.883125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.895412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b193-f94c-4384-b55c-602a7a3ca23c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.901982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.902699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.903831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.903831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.904043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:05.904352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.905973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.923342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1043/2065] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:05.928513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:05.939243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f95e9a-0668-413e-b975-3e3f8c8c2e07 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:05.945776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:05.946984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:05.947519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:05.947982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:05.948865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:05.951072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:05.988594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1023/2066] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:05 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:05.993550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.003884 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.004801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105f749-4260-4335-8f73-dba9c576808a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.006517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:06.099076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.099845 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.100132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.100402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.101109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.103073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.111164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d667-b87c-49da-aa57-8de85044277b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.116459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.117624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.118027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.118401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] PATH_INFO: `/v3/projects/e642cd4293294b49b1fb5c475e02a062` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.119932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e642cd4293294b49b1fb5c475e02a062)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.122234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.127738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1044/2067] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:05 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:06.130387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.142758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b39a2-f2b9-4843-89ba-74941dc8612f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.148067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.148978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.149442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.149942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.151248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.153628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.169688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1045/2068] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:06.171226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.180278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e642cd4293294b49b1fb5c475e02a062', 'request_id': 'req-c0f8f259-b944-463d-aece-2dce3ee03428'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.181098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b309cce-001b-4693-a579-69eae5b9199c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.186406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e642cd4293294b49b1fb5c475e02a062', 'request_id': 'req-c0f8f259-b944-463d-aece-2dce3ee03428'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.195609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e642cd4293294b49b1fb5c475e02a062', 'request_id': 'req-c0f8f259-b944-463d-aece-2dce3ee03428'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.207551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] The token cache is being invalidate because project e642cd4293294b49b1fb5c475e02a062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:06.207875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.208531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.211258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1024/2069] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:06 2022] DELETE /identity/v3/projects/e642cd4293294b49b1fb5c475e02a062 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:06.214783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.216210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:06.247648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.248511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.248894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.251222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.251222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.251888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.268726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1046/2070] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:39:06.269884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.277106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:06.290041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f259-b944-463d-aece-2dce3ee03428 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.291878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df118c-41b2-4407-b897-c23ddfed1045 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.297185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.298102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.298385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.298668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] PATH_INFO: `/v3/projects/45fcf4b1aba746909cbbf3f5a24d6734/users/12cfad0626364a33a27494abff1bc167/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.299251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.300286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.300566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.300869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] PATH_INFO: `/v3/users/129815894d6141bead498fc71179bdb9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.302268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129815894d6141bead498fc71179bdb9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.305164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.315827 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fcf4b1aba746909cbbf3f5a24d6734, user_id=12cfad0626364a33a27494abff1bc167, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.318608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd57b-9aaf-4461-a3b8-522c3f557647 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.346348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1047/2071] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:06 2022] PUT /identity/v3/projects/45fcf4b1aba746909cbbf3f5a24d6734/users/12cfad0626364a33a27494abff1bc167/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:06.359137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.359137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.359395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.371483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129815894d6141bead498fc71179bdb9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.384319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129815894d6141bead498fc71179bdb9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.385053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129815894d6141bead498fc71179bdb9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.386117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129815894d6141bead498fc71179bdb9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.387017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] MFA Rules not processed for user `12cfad0626364a33a27494abff1bc167`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:06.388363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:06.399301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129815894d6141bead498fc71179bdb9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:06.418288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1025/2072] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:06 2022] DELETE /identity/v3/users/129815894d6141bead498fc71179bdb9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:06.478801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1048/2073] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:06.483666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.485137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:06.555744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd688cc-fa07-4980-a1a5-05176f2e6af7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.566467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.567157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.567435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.567729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.568717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.571035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.613083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1026/2074] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:06 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:06.617564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.686959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb83f8-e23e-4871-875a-2f954569c821 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.756142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.756863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.757184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.757409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.758135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.760167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.781539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1049/2075] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:06 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:06.785810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.800787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946c9c7-2c88-48ef-8111-5b2e1260be1d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.806278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.806987 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.807272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.807552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.808371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.810057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.823493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1027/2076] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:06.828560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.839760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252a57-df7a-4de3-b0d4-ed1c342a09ef admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.845256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.846224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.846500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.846770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] PATH_INFO: `/v3/projects/1874b5c2889c448da8767a2961cfc20a/users/09e5a56317b7450dba4b843ce9422a61/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.873620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1874b5c2889c448da8767a2961cfc20a, user_id=09e5a56317b7450dba4b843ce9422a61, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.876815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.896006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1050/2077] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:06 2022] PUT /identity/v3/projects/1874b5c2889c448da8767a2961cfc20a/users/09e5a56317b7450dba4b843ce9422a61/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:06.900631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.911524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049901b4-9e32-49ea-86d8-042401d3e333 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:06.969745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:06.970641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:06.970964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:06.971302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:06.972142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:06.973873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31236ad7-4eee-429a-90ba-06419dcfc319 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:06.984820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1028/2078] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:06.989125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:06.999916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2a0f9-7b6c-4be4-a918-5db2a2a25d6f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.004911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.005849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.006157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.006468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] PATH_INFO: `/v3/projects/1874b5c2889c448da8767a2961cfc20a/users/09e5a56317b7450dba4b843ce9422a61/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.008548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1874b5c2889c448da8767a2961cfc20a, user_id=09e5a56317b7450dba4b843ce9422a61, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.011540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.022089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1051/2079] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:06 2022] PUT /identity/v3/projects/1874b5c2889c448da8767a2961cfc20a/users/09e5a56317b7450dba4b843ce9422a61/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:07.032573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.032859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.033126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.061650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] MFA Rules not processed for user `09e5a56317b7450dba4b843ce9422a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:07.062998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.172087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1029/2080] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:07.187276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.189342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.224685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.226798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.256981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f012a4-c60f-4140-a0c1-0f9cc4167784 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.261152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.261865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.262235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.262426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.277349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.278844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.290774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1052/2081] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:07.317346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e620c-1c6c-49a7-b2e9-48141d821b86 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.328697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.329857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.330155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.330638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] PATH_INFO: `/v3/projects/c14143cc9dea4841b8513863ffb11850` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.333591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14143cc9dea4841b8513863ffb11850)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.335756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.396775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14143cc9dea4841b8513863ffb11850', 'request_id': 'req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.402941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14143cc9dea4841b8513863ffb11850', 'request_id': 'req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.413008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14143cc9dea4841b8513863ffb11850', 'request_id': 'req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.426508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] The token cache is being invalidate because project c14143cc9dea4841b8513863ffb11850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:07.426890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.427595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.429972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1030/2082] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:07 2022] DELETE /identity/v3/projects/c14143cc9dea4841b8513863ffb11850 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:07.434417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.445735 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8d60-8a18-4a40-a427-f2b95cb5cd43 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.504802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.505776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.506294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.506520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] PATH_INFO: `/v3/users/89653995796745ba9e34ed759d697298` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.507926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=89653995796745ba9e34ed759d697298)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.510189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.562889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89653995796745ba9e34ed759d697298'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.575070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89653995796745ba9e34ed759d697298'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.582435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89653995796745ba9e34ed759d697298'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.583183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89653995796745ba9e34ed759d697298'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.592185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89653995796745ba9e34ed759d697298'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:07.604145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1053/2083] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:07 2022] DELETE /identity/v3/users/89653995796745ba9e34ed759d697298 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:07.645014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.646752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.726136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9b1a-d997-425d-b1f2-4e3490a6e846 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.796130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e5a56317b7450dba4b843ce9422a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1874b5c2889c448da8767a2961cfc20a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.797028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.797234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.797508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.798250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:07.798569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.800200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.832366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1031/2084] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:07.836449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.838729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.855099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cac95-6e76-4cd9-8e9b-1bd52ed4f9ad admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.860878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e5a56317b7450dba4b843ce9422a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1874b5c2889c448da8767a2961cfc20a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.860878 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.861086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.861234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.861960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.863976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.894240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1054/2085] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:07 2022] POST /identity/v3/projects => generated 354 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:07.898669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.906570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:07.908518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:07.909974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7b413-4e66-4b48-9294-2afc4ab893b5 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.975723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e5a56317b7450dba4b843ce9422a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1874b5c2889c448da8767a2961cfc20a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.976428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.976715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.976997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.977727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:07.978049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:07.979664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:07.991375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4658-e8cc-4d7b-87ba-5d7dfefd8c83 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:07.994845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1032/2086] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:07.996181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:07.997088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:07.997371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:07.997797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] PATH_INFO: `/v3/projects/103e3cf715f545df89deaf127340f7b6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:07.998992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103e3cf715f545df89deaf127340f7b6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:08.000934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:08.027559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:08.038817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef08af-7295-404e-b74b-d8f75dca9652 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:08.051956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103e3cf715f545df89deaf127340f7b6', 'request_id': 'req-d3b83aad-8244-4593-a24e-2908ab248a40'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.057445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103e3cf715f545df89deaf127340f7b6', 'request_id': 'req-d3b83aad-8244-4593-a24e-2908ab248a40'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.065696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103e3cf715f545df89deaf127340f7b6', 'request_id': 'req-d3b83aad-8244-4593-a24e-2908ab248a40'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.078636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] The token cache is being invalidate because project 103e3cf715f545df89deaf127340f7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:08.079042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.079725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.081305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1055/2087] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:07 2022] DELETE /identity/v3/projects/103e3cf715f545df89deaf127340f7b6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:08.097718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e5a56317b7450dba4b843ce9422a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1874b5c2889c448da8767a2961cfc20a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:08.098630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:08.098914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:08.099186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] PATH_INFO: `/v3/projects/f390618da3e242b3881f93b260cc9a0f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:08.100631 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f390618da3e242b3881f93b260cc9a0f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:08.102633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:08.155288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f390618da3e242b3881f93b260cc9a0f', 'request_id': 'req-1be928cd-1c6f-4587-8b15-e3bd988a85e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.161168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f390618da3e242b3881f93b260cc9a0f', 'request_id': 'req-1be928cd-1c6f-4587-8b15-e3bd988a85e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.173395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f390618da3e242b3881f93b260cc9a0f', 'request_id': 'req-1be928cd-1c6f-4587-8b15-e3bd988a85e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.193668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] The token cache is being invalidate because project f390618da3e242b3881f93b260cc9a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:08.194386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.195423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-1be928cd-1c6f-4587-8b15-e3bd988a85e4 tempest-VolumeQuotaClassesTest-425044706 tempest-VolumeQuotaClassesTest-425044706-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.198859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1033/2088] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:08 2022] DELETE /identity/v3/projects/f390618da3e242b3881f93b260cc9a0f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:08.420666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:08.422118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:08.494920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83aad-8244-4593-a24e-2908ab248a40 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:08.557154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:08.558042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:08.558317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:08.558578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] PATH_INFO: `/v3/users/12cfad0626364a33a27494abff1bc167` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:08.559898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12cfad0626364a33a27494abff1bc167)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:08.561828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:08.620073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12cfad0626364a33a27494abff1bc167'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.632049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12cfad0626364a33a27494abff1bc167'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.639089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12cfad0626364a33a27494abff1bc167'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.639875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12cfad0626364a33a27494abff1bc167'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.648583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12cfad0626364a33a27494abff1bc167'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:08.655910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1056/2089] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:08 2022] DELETE /identity/v3/users/12cfad0626364a33a27494abff1bc167 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:08.661363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:08.661653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:08.662075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:08.686843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:08.688225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:08.754352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1034/2090] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:08.764254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:08.765932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:08.827246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b519af9-f9bd-437f-aea6-d1bc0bd7697b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:08.830961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:08.831866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:08.832148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:08.832388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:08.843188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:08.844666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:08.854512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1057/2091] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:09.149396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:09.151194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:09.164004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab881a76-ece5-425b-8518-09b2777bdd32 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:09.170614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:09.171519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:09.171835 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:09.172112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] PATH_INFO: `/v3/projects/45fcf4b1aba746909cbbf3f5a24d6734` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:09.173417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fcf4b1aba746909cbbf3f5a24d6734)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:09.175371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:09.229009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fcf4b1aba746909cbbf3f5a24d6734', 'request_id': 'req-4256f162-0a18-4d9f-bc54-41c2faef08cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.234607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fcf4b1aba746909cbbf3f5a24d6734', 'request_id': 'req-4256f162-0a18-4d9f-bc54-41c2faef08cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.246217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fcf4b1aba746909cbbf3f5a24d6734', 'request_id': 'req-4256f162-0a18-4d9f-bc54-41c2faef08cb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.258222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] The token cache is being invalidate because project 45fcf4b1aba746909cbbf3f5a24d6734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:09.258511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.259131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.260680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1035/2092] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:09 2022] DELETE /identity/v3/projects/45fcf4b1aba746909cbbf3f5a24d6734 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:09.265059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:09.274964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174170-8607-4354-8119-56078ebca5fc service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:09.332558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:09.333435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:09.333717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:09.334083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] PATH_INFO: `/v3/users/09e5a56317b7450dba4b843ce9422a61` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:09.335526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e5a56317b7450dba4b843ce9422a61)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:09.337495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:09.399577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e5a56317b7450dba4b843ce9422a61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.414144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e5a56317b7450dba4b843ce9422a61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.422242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e5a56317b7450dba4b843ce9422a61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.423035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e5a56317b7450dba4b843ce9422a61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.432655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-188ad825-fdbc-4f3d-b055-09033b4698d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e5a56317b7450dba4b843ce9422a61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.438989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1058/2093] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:09 2022] DELETE /identity/v3/users/09e5a56317b7450dba4b843ce9422a61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:09.794779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:09.796609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:09.813656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256f162-0a18-4d9f-bc54-41c2faef08cb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:09.877997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:09.879031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:09.879444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:09.879709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] PATH_INFO: `/v3/projects/1874b5c2889c448da8767a2961cfc20a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:09.881148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1874b5c2889c448da8767a2961cfc20a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:09.883200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:09.937560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1874b5c2889c448da8767a2961cfc20a', 'request_id': 'req-b297e68c-d005-494b-91ac-2f7fc03d1ce2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.942975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1874b5c2889c448da8767a2961cfc20a', 'request_id': 'req-b297e68c-d005-494b-91ac-2f7fc03d1ce2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.952642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1874b5c2889c448da8767a2961cfc20a', 'request_id': 'req-b297e68c-d005-494b-91ac-2f7fc03d1ce2'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.964193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] The token cache is being invalidate because project 1874b5c2889c448da8767a2961cfc20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:09.964496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.965346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b297e68c-d005-494b-91ac-2f7fc03d1ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:09.967152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1036/2094] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:09 2022] DELETE /identity/v3/projects/1874b5c2889c448da8767a2961cfc20a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:09.972360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:09.972653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:09.972928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:09.993609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:09.995173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:10.058684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1059/2095] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:10.067031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.067333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.067613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.088623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:10.089852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:10.101323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1037/2096] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:10.105350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.115085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0de3a-282a-4ef5-8c90-5bb60619bd88 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.120156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.120828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.121108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.121388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.122122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:10.122440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.124106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.139102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1060/2097] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:10.143538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.153011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66fa5-b57d-4f8f-b37f-aca42c3f97cb None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.158253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.158583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.158860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.159131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.159869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.161784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.203137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1038/2098] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:10.204385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.214367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411784-faaa-49fb-8d8a-44ea781e3f09 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.279787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.280471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.280767 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.281120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.281723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.283752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.309096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1061/2099] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:10.313043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.328686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8120-ad6e-41c4-9fe1-7c50fe1af3d3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.333333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.334497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.334686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.335273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.336397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.338231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.350254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1039/2100] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:10.354734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.367160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41e2f-898e-4a83-b92b-f3e1538415b4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.372105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.372868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.373217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.373590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.374453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.376211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494231-e9db-4e01-9d6a-91ee72a7a176 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.386931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1062/2101] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:10.391164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.402733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a434b-7dd9-449f-899a-307292d6bb7f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.407438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.408474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.408818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.409155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] PATH_INFO: `/v3/projects/1ab0627fa681494c93f0f9e0197ea978/users/d6cd762c22e94f05974f4806b0636f03/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.426678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab0627fa681494c93f0f9e0197ea978, user_id=d6cd762c22e94f05974f4806b0636f03, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.429504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.444967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1040/2102] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:10 2022] PUT /identity/v3/projects/1ab0627fa681494c93f0f9e0197ea978/users/d6cd762c22e94f05974f4806b0636f03/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:10.456351 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.456876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.456968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.486928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] MFA Rules not processed for user `d6cd762c22e94f05974f4806b0636f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:10.488285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:10.555757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1063/2103] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:10.560258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.629973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110330-e5bf-4d03-a9c0-dc66b2edc953 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.635060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.635743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.636022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.636299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.637800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.640171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.673331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1041/2104] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:10.674974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.686243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e83b5-c1f6-4421-b643-0d7dbf5f7e1a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.742753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.743363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.743645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.743952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.744654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.746609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.773050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1064/2105] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:10 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:10.774335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.784853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3916-8049-432b-9f69-3da78c03a634 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.790044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.790756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.791044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.791334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.792124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.793737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.805231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1042/2106] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:10.809560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.820876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee4260-39de-4891-bb00-be97bf5aa91b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.827009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.828028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.828308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.828579 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] PATH_INFO: `/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399/users/b3786c4a97be4d698102fb667b5316fb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.846504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c72cf60d7943c3be7a4a3d97a6c399, user_id=b3786c4a97be4d698102fb667b5316fb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.849301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.867564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1065/2107] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:10 2022] PUT /identity/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399/users/b3786c4a97be4d698102fb667b5316fb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:10.872586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.883207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4f45-8d35-4bd0-a08f-2f571a7a80b4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.947457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.948197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.948474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.948746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.949490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.951198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4c00c-fec7-4c60-a934-cc7cb296147e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.965040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1043/2108] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:39:10.966318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:10.976896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4ab-fccc-472a-b7ec-8f099ed6d6d6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:10.981636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:10.982545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:10.982826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:10.983100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] PATH_INFO: `/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399/users/b3786c4a97be4d698102fb667b5316fb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:10.985134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c72cf60d7943c3be7a4a3d97a6c399, user_id=b3786c4a97be4d698102fb667b5316fb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:10.987839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:10.999999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1066/2109] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:10 2022] PUT /identity/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399/users/b3786c4a97be4d698102fb667b5316fb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:11.010318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:11.010603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:11.010880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:11.037112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] MFA Rules not processed for user `b3786c4a97be4d698102fb667b5316fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:11.038459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:11.106767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1044/2110] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:11.118102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:11.120462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:11.178984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f326-5287-44bc-bf85-0bbfb4baa8ee admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:11.185485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:11.186416 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:11.186663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:11.186933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:11.198435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:11.199907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8c97-3e8e-4fa6-953b-83f534949620 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:11.209962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1067/2111] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:11.814534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:11.880277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d91a-7f08-4fd7-8827-d74d59326d60 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:11.885501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:11.886399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:11.886682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:11.886956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] PATH_INFO: `/v3/users/d6cd762c22e94f05974f4806b0636f03` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:11.888584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cd762c22e94f05974f4806b0636f03)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:11.890602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:11.939855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cd762c22e94f05974f4806b0636f03'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:11.951663 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cd762c22e94f05974f4806b0636f03'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:11.952526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cd762c22e94f05974f4806b0636f03'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:11.953148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cd762c22e94f05974f4806b0636f03'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:11.962358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cd762c22e94f05974f4806b0636f03'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:11.975558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1045/2112] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:11 2022] DELETE /identity/v3/users/d6cd762c22e94f05974f4806b0636f03 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:11.980310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:11.980784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:11.980996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:12.000865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:12.002174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:12.064821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1068/2113] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:12.075107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:12.076780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:12.141906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34904d-0521-4d64-bfbc-80dea0809e76 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:12.147034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:12.147863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:12.148138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:12.148417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:12.162737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:12.164960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:12.179980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1046/2114] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:39:12.464070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:12.466947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:12.486519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6fbe4-b62d-460f-9512-eb1d6df1b354 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:12.494232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:12.495870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:12.496745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:12.496876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] PATH_INFO: `/v3/projects/1ab0627fa681494c93f0f9e0197ea978` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:12.499061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab0627fa681494c93f0f9e0197ea978)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:12.512411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:12.567958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab0627fa681494c93f0f9e0197ea978', 'request_id': 'req-42fffc86-eddc-468b-a84d-ff99b911bab5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.573499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab0627fa681494c93f0f9e0197ea978', 'request_id': 'req-42fffc86-eddc-468b-a84d-ff99b911bab5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.585533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab0627fa681494c93f0f9e0197ea978', 'request_id': 'req-42fffc86-eddc-468b-a84d-ff99b911bab5'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.598708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] The token cache is being invalidate because project 1ab0627fa681494c93f0f9e0197ea978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:12.599100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.599894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.602311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1069/2115] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:12 2022] DELETE /identity/v3/projects/1ab0627fa681494c93f0f9e0197ea978 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:12.607733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:12.616312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f23a-6bc2-4617-b88f-d8ac212630d3 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:12.676836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:12.677746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:12.678031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:12.678336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] PATH_INFO: `/v3/users/b3786c4a97be4d698102fb667b5316fb` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:12.679754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3786c4a97be4d698102fb667b5316fb)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:12.681721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:12.729056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3786c4a97be4d698102fb667b5316fb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.740529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3786c4a97be4d698102fb667b5316fb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.741242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3786c4a97be4d698102fb667b5316fb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.741891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3786c4a97be4d698102fb667b5316fb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.750847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-70792f34-ec22-43fc-986f-e9c9d67e2d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3786c4a97be4d698102fb667b5316fb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:12.764233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1047/2116] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:12 2022] DELETE /identity/v3/users/b3786c4a97be4d698102fb667b5316fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:13.056971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.058487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:13.076455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc86-eddc-468b-a84d-ff99b911bab5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.139600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.140522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.140799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.141067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] PATH_INFO: `/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.142282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c72cf60d7943c3be7a4a3d97a6c399)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.144280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.191539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c72cf60d7943c3be7a4a3d97a6c399', 'request_id': 'req-48e6567f-762f-44eb-a49c-3e0baeeca5cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:13.197426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c72cf60d7943c3be7a4a3d97a6c399', 'request_id': 'req-48e6567f-762f-44eb-a49c-3e0baeeca5cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:13.205705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c72cf60d7943c3be7a4a3d97a6c399', 'request_id': 'req-48e6567f-762f-44eb-a49c-3e0baeeca5cb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:13.217660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] The token cache is being invalidate because project 72c72cf60d7943c3be7a4a3d97a6c399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:13.217955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:13.218596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-48e6567f-762f-44eb-a49c-3e0baeeca5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:13.220165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1070/2117] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:13 2022] DELETE /identity/v3/projects/72c72cf60d7943c3be7a4a3d97a6c399 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:13.226258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.226724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.227018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.244953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:13.246188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:13.309358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1048/2118] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:13.322487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.322768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.323039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.344568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:13.346410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:13.358705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1071/2119] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:13.363143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.373387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad316f-8c62-450a-8b8b-04960b785b78 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.379265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.379972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.380249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.380528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.381272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:13.381574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.383329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.395605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1049/2120] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:13.400342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.410090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae28364-0a4b-486d-a64b-7070a14a563e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.416207 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.416871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.417154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.417427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.418114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.420422 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.453619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1072/2121] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:13 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:13.455337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.465668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e904b6-0cb3-4ae2-b4d7-2e14a88ad9e2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.521723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.522437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.522719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.523146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.524199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.526229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.549387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1050/2122] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:13 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:13.555459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.570288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a027-bc3d-4267-9e61-4915faa556ef admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.575465 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.576169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.576443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.576714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.577444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.579069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.589226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1073/2123] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:13.593231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.603568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdd6d7-72d7-4f14-a051-72ba4dea5717 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.608620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.609293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.609580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.609858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.610557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.612238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7579c-2b81-44f0-8245-a73e2dabeb77 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.623347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1051/2124] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:13.627719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.637714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159f89-8dea-49df-accd-28844506f40b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.643130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.644090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.644368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.644638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] PATH_INFO: `/v3/projects/4c7709ad922a43ad8cc7d28aba58b910/users/367c1688b4a54a689f1485556c9b1d8b/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.661177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7709ad922a43ad8cc7d28aba58b910, user_id=367c1688b4a54a689f1485556c9b1d8b, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.663927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.680526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1074/2125] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:13 2022] PUT /identity/v3/projects/4c7709ad922a43ad8cc7d28aba58b910/users/367c1688b4a54a689f1485556c9b1d8b/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:13.690919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.691336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.691466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.720526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] MFA Rules not processed for user `367c1688b4a54a689f1485556c9b1d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:13.721739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:13.789493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1052/2126] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:13.800941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:13.802914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:13.871874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04869a5-bc48-46aa-b109-bd2b3fc2624f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:13.875877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:13.876544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:13.876825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:13.877099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:13.885802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:13.887246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d288ba-4dfb-4616-ae0d-b501f4abd4c1 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:13.896129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1075/2127] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:26.527960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:26.593951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741718c-357b-4d04-a5c3-0d86318def8f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:26.599419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:26.600345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:26.600623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:26.600897 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] PATH_INFO: `/v3/users/367c1688b4a54a689f1485556c9b1d8b` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:26.602178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=367c1688b4a54a689f1485556c9b1d8b)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:26.604378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:26.657605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367c1688b4a54a689f1485556c9b1d8b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:26.670645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367c1688b4a54a689f1485556c9b1d8b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:26.671373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367c1688b4a54a689f1485556c9b1d8b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:26.672019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367c1688b4a54a689f1485556c9b1d8b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:26.680978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367c1688b4a54a689f1485556c9b1d8b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:26.693559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1053/2128] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:26 2022] DELETE /identity/v3/users/367c1688b4a54a689f1485556c9b1d8b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:26.698141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:26.698623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:26.698713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:26.715374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:26.716573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:26.779360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1076/2129] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:26.788957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:26.790493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:26.854341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81b99d-c3f1-4f22-9927-0f3cfae240eb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:26.858440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:26.859144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:26.859512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:26.859824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:26.869823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:26.871295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444af0a-f3b5-4d6b-a926-d2ef03812d03 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:26.881187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1054/2130] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:27.149759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.151601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:27.163606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94f29-22a1-46af-b395-906e8849aeaa None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.169937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.170800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.171107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.171375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] PATH_INFO: `/v3/projects/4c7709ad922a43ad8cc7d28aba58b910` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.172618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7709ad922a43ad8cc7d28aba58b910)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.174615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.223514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7709ad922a43ad8cc7d28aba58b910', 'request_id': 'req-001e0448-70df-400a-acb3-2642a50c6f50'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:27.229302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7709ad922a43ad8cc7d28aba58b910', 'request_id': 'req-001e0448-70df-400a-acb3-2642a50c6f50'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:27.238383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7709ad922a43ad8cc7d28aba58b910', 'request_id': 'req-001e0448-70df-400a-acb3-2642a50c6f50'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:27.249413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] The token cache is being invalidate because project 4c7709ad922a43ad8cc7d28aba58b910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:27.249699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:27.250325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-001e0448-70df-400a-acb3-2642a50c6f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:27.251954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1077/2131] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:27 2022] DELETE /identity/v3/projects/4c7709ad922a43ad8cc7d28aba58b910 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:27.257038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.257317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.257598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.275312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:27.276501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:27.334036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1055/2132] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:27.343137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.343440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.343819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.364339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:27.365543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:27.374855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1078/2133] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:27.379369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.389766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f459df-225f-4de1-bc80-a6bc1474c571 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.395607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.396301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.396578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.396848 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.397569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:27.397873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.399475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.412008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1056/2134] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:27.416874 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.428585 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4c1f-c46b-43a3-aa53-e3aef181c078 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.435432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.436140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.436421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.436697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.437411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.439372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.469584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1079/2135] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:27 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:27.473923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.484169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedda05a-4aa4-4681-be88-5ac0fd6266e4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.539867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.540497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.540757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.541510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.542023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.543992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.567804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1057/2136] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:27 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:27.572298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.582799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843114e-0357-4913-919c-ba7c064b055d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.587604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.588411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.588688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.588955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.589682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.591285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.601692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1080/2137] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:27.606387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.616809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f031-f656-4723-bb89-995c99623b20 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.622212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.622892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.623174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.623459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.624236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.625850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769a08b-6f98-4466-85fb-aa1fcc227adb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.636310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1058/2138] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:27.641184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.657127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270182a9-fe5e-4504-adec-2b21e6826a4b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.666561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.667379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.667654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.667966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] PATH_INFO: `/v3/projects/ec6ea995239c47df80dd8c7ff0aa23f3/users/691afedb8d7c4ae3a69843fe6198c210/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.683548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ea995239c47df80dd8c7ff0aa23f3, user_id=691afedb8d7c4ae3a69843fe6198c210, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.686242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.701249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1081/2139] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:27 2022] PUT /identity/v3/projects/ec6ea995239c47df80dd8c7ff0aa23f3/users/691afedb8d7c4ae3a69843fe6198c210/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:27.706496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d3cc-e9eb-4a35-83b2-6f81ad57bc6f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.706792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d3cc-e9eb-4a35-83b2-6f81ad57bc6f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.707072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d3cc-e9eb-4a35-83b2-6f81ad57bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.725853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cb20d3cc-e9eb-4a35-83b2-6f81ad57bc6f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:27.727060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cb20d3cc-e9eb-4a35-83b2-6f81ad57bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:27.794540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1059/2140] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:27.805896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:27.808112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:27.869597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd446f86-82e7-45ab-b4e1-9d4f35b7fd04 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:27.873444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:27.874104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:27.874346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:27.874648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:27.883721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:27.885210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:27.895026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1082/2141] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:28.503592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae8ba-3867-4f4e-90d4-a07407b17382 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:28.504169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae8ba-3867-4f4e-90d4-a07407b17382 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:28.504460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae8ba-3867-4f4e-90d4-a07407b17382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:28.532063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-89dae8ba-3867-4f4e-90d4-a07407b17382 None None] MFA Rules not processed for user `691afedb8d7c4ae3a69843fe6198c210`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:28.533283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-89dae8ba-3867-4f4e-90d4-a07407b17382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:28.597445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1060/2142] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:28.608688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:28.610129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:28.667414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24abd-8d26-431b-aa6f-aebeb11a75b9 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:28.671536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:28.672231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:28.672520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:28.672797 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:28.682642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:28.684301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1e02-3283-4be6-9821-f24eaf680578 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:28.694558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1083/2143] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:32.149495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:32.150057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:32.150057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:32.184902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] MFA Rules not processed for user `691afedb8d7c4ae3a69843fe6198c210`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:32.186118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:32.212657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1061/2144] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:32.530897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:32.531477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:32.531477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:32.552367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:32.553737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:32.637284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1084/2145] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:32.685657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:32.687340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:32.778653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeaf4a-1704-4475-850c-867480e1b9b5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:32.784841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:32.785613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:32.785963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:32.786371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:32.798019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:32.799810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ff159-8447-4a5d-8f6e-02fcbcae9482 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:32.808656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1062/2146] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:39:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:39:40.947033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:40.949795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:41.009819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186357d-96a4-4910-856b-d0ac0c403cc6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:41.015167 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:41.016434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:41.017651 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:41.018075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] PATH_INFO: `/v3/users/81b483283ebd4e22928f50e002788688` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:41.019588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b483283ebd4e22928f50e002788688)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:41.022248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:41.082865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b483283ebd4e22928f50e002788688'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.096969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b483283ebd4e22928f50e002788688'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.116296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b483283ebd4e22928f50e002788688'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.118063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b483283ebd4e22928f50e002788688'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.130007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b483283ebd4e22928f50e002788688'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.134945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1085/2147] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:40 2022] DELETE /identity/v3/users/81b483283ebd4e22928f50e002788688 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:41.140033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:41.140586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:41.140795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:41.174622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:41.176334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:41.255401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1063/2148] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:41.269109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:41.270589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:41.370997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff47f6-8d27-40fc-8925-a96768683d5a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:41.374768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:41.375714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:41.375714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:41.376077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:41.387664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:41.389558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c6ef6-e503-4a96-a735-9c934cc0b9ff service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:41.405006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1086/2149] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:39:41.803344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:41.805505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:41.824076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2bee3-752e-462f-855b-b3954095ddd3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:41.830610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:41.831520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:41.831867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:41.832143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] PATH_INFO: `/v3/projects/504610e78fc74e32b94f0c049282bb16` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:41.833352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] RBAC: Authorizing `identity:delete_project(project_id=504610e78fc74e32b94f0c049282bb16)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:41.837230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:41.897414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504610e78fc74e32b94f0c049282bb16', 'request_id': 'req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.904322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504610e78fc74e32b94f0c049282bb16', 'request_id': 'req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.917343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504610e78fc74e32b94f0c049282bb16', 'request_id': 'req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.930367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] The token cache is being invalidate because project 504610e78fc74e32b94f0c049282bb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:41.930651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.931429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13ca6cf2-e8ea-4ef0-934b-323ab6f2474c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:41.933396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1064/2150] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:41 2022] DELETE /identity/v3/projects/504610e78fc74e32b94f0c049282bb16 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:41.938196 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:41.938485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:41.938771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:41.979361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:41.981622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:42.062046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.062312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.062600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.065977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1087/2151] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:42.087093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:42.088466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:42.097905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1065/2152] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:42.102031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.112450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6bd00-d2fd-46b0-989e-8b717eaa2726 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.120706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.121510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.124531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.124864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.125644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:42.126706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.131323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.167556 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1088/2153] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:42.174313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.192657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a3843-8068-41a4-8ade-8cf3c8f9931f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.202129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.203040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.203481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.203933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.204811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.207041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.244737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1066/2154] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:42 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:42.245753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.263494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe97a-524a-49a9-ae00-8e9cb5d8ce5b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.341712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.342538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.342538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.342917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.344142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.346910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.393391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.396300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1089/2155] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:42 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:42.412334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db90a-f488-4679-a13a-be8037de0b8d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.418881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.420498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.421019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.421522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.422517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.424453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.443601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.444707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1067/2156] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:42.459098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1f7-e812-4248-812d-1e432472ed90 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.466627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.467728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.468232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.468746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.469718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.472946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262673-474c-47e1-a706-d33db9230023 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.501518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.512891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1090/2157] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:42.514892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a92fc-94c7-4dfb-8bf8-5514395d2c99 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.544734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.546094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.546578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.547066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] PATH_INFO: `/v3/projects/eb08ec33a1c8431bbe1464d11be9bfc6/users/a77a9da6c6f74aa3b9e58a1d1b84d14b/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.567852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb08ec33a1c8431bbe1464d11be9bfc6, user_id=a77a9da6c6f74aa3b9e58a1d1b84d14b, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.572148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.620202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1068/2158] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:42 2022] PUT /identity/v3/projects/eb08ec33a1c8431bbe1464d11be9bfc6/users/a77a9da6c6f74aa3b9e58a1d1b84d14b/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:42.668694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1ff9-262f-4a15-b246-e5527aafa12a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.668902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1ff9-262f-4a15-b246-e5527aafa12a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.669534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1ff9-262f-4a15-b246-e5527aafa12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.703114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0b0c1ff9-262f-4a15-b246-e5527aafa12a None None] MFA Rules not processed for user `a77a9da6c6f74aa3b9e58a1d1b84d14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:42.708978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0b0c1ff9-262f-4a15-b246-e5527aafa12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:42.834161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1091/2159] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:42.855112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:42.857499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:42.938227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ca56-5e2a-47ec-9180-dba1d88cf5be admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:42.941857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:42.942533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:42.944780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:42.944780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:42.957197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:42.958857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452291-9697-453c-8be0-7223af41abb3 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:42.972030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1069/2160] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:44.561495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:44.562076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:44.562076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:44.583281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] MFA Rules not processed for user `a77a9da6c6f74aa3b9e58a1d1b84d14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:44.584967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:44.609273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1092/2161] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:51.352521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:51.353067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:51.353067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:51.380794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:51.382121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:51.445846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1070/2162] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:51.458672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:51.460277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:51.540427 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34f9b-9601-4dde-9f9b-182f13b78888 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:51.550499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:51.551546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:51.552534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:51.552820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:51.562548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:51.564204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:51.573071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1093/2163] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:39:53.615535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:53.617576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:53.704886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c21c-5806-49b7-ad9c-698e9698f663 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:53.709667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:53.710571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:53.710850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:53.711167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] PATH_INFO: `/v3/users/35fc8699f921492282b5be9b5fab5b24` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:53.712483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fc8699f921492282b5be9b5fab5b24)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:53.714441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:53.772099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fc8699f921492282b5be9b5fab5b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:53.784856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fc8699f921492282b5be9b5fab5b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:53.785620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fc8699f921492282b5be9b5fab5b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:53.786269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fc8699f921492282b5be9b5fab5b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:53.794919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2108defb-a173-44b9-82bd-6b57de98c10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fc8699f921492282b5be9b5fab5b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:53.814653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1071/2164] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:53 2022] DELETE /identity/v3/users/35fc8699f921492282b5be9b5fab5b24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:54.031348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.043895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb29f-99a0-404d-8032-cc77ec49860e service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.131132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.132360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.132642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.132921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] PATH_INFO: `/v3/projects/eeba321debcd40e6ba9eb9a5c1e534ce` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.134161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeba321debcd40e6ba9eb9a5c1e534ce)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.136112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.189491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'request_id': 'req-770ae01f-a607-4417-9844-dca475710dd9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:54.195570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'request_id': 'req-770ae01f-a607-4417-9844-dca475710dd9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:54.206336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeba321debcd40e6ba9eb9a5c1e534ce', 'request_id': 'req-770ae01f-a607-4417-9844-dca475710dd9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:54.218664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] The token cache is being invalidate because project eeba321debcd40e6ba9eb9a5c1e534ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:54.218949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:54.221179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-770ae01f-a607-4417-9844-dca475710dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:54.222044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1094/2165] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:54 2022] DELETE /identity/v3/projects/eeba321debcd40e6ba9eb9a5c1e534ce => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:54.227947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.228608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.228608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.261363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:54.264073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:54.359522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1072/2166] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:54.367542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.367892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.368174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.394848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:54.396019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:54.409700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1095/2167] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:54.415538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.431812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28086106-40b5-4621-b0fa-489a0b342fc7 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.438572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.439257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.439506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.439850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.440595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:54.440901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.442519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.455853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1073/2168] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:54.462600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.475567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0c9c-3bea-4c8b-ba0a-526b5396d46b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.484093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.484831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.485063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.485339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.486183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.488668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.538331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1096/2169] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:54 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:54.542889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.554369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118eb56-1711-470f-9463-9fc637c011af admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.631125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.631844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.632120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.632453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.633220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.635168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.663520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1074/2170] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:54 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:54.668951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.680629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2880-2aba-42fc-961c-dd4406b73083 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.685812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.686590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.687386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.687667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.688444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.690125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.702132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1097/2171] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:54.708509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.725315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ca73-f191-4901-91b1-84185a3374d7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.732889 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.734395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.735008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.735582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.737277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.740451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e82268-358d-475b-9941-2cb866a35ee1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.752191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1075/2172] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:54.759122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.774696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e762cb-505a-4442-b96d-b9e7e8b91318 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:54.783815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:54.785249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.785702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.786159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] PATH_INFO: `/v3/projects/fbe01d9e5d6d49f0b5318e94c0995566/users/be934d7fe2ea4522bfdf186af956427a/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.804569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe01d9e5d6d49f0b5318e94c0995566, user_id=be934d7fe2ea4522bfdf186af956427a, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:54.808950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:54.836018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1098/2173] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:54 2022] PUT /identity/v3/projects/fbe01d9e5d6d49f0b5318e94c0995566/users/be934d7fe2ea4522bfdf186af956427a/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:54.846780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:54.847042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:54.847338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:54.882225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] MFA Rules not processed for user `be934d7fe2ea4522bfdf186af956427a`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:54.883505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:54.972907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1076/2174] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:54.988586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:54.990666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:55.055990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a38c4b-62a7-4e5d-8705-9387f637780e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:55.059807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:55.060470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.060749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.061061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.070247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:55.072138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfaaa4-0b4c-4620-bf2a-0b5fa628af26 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:55.083816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1099/2175] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:55.121406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:55.229801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dcfd0-24a2-4182-a328-899d48ea5cda None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:55.236106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:55.237118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.237423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.237790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] PATH_INFO: `/v3/users/be934d7fe2ea4522bfdf186af956427a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.239109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be934d7fe2ea4522bfdf186af956427a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:55.241176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:55.302909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be934d7fe2ea4522bfdf186af956427a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.325846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be934d7fe2ea4522bfdf186af956427a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.326721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be934d7fe2ea4522bfdf186af956427a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.327865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be934d7fe2ea4522bfdf186af956427a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.339022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be934d7fe2ea4522bfdf186af956427a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.355041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1077/2176] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:39:55 2022] DELETE /identity/v3/users/be934d7fe2ea4522bfdf186af956427a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:55.359953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.360472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.361242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.380105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:55.381425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:55.456779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1100/2177] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:55.466156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:55.467782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:55.532528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792dee-a382-4c70-bed8-4f86f8136fe6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:55.536446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:55.537143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.537440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.537697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.547735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:55.549209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f88df-c79f-4100-84fe-efbf0d0391a3 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:55.559163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1078/2178] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:39:55.834392 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:55.835918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:55.851406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bee31-08ca-48ad-b5d9-dccbe394e409 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:55.857069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:55.858030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.858442 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.858822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] PATH_INFO: `/v3/projects/fbe01d9e5d6d49f0b5318e94c0995566` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.860166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe01d9e5d6d49f0b5318e94c0995566)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:55.862210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:55.923515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe01d9e5d6d49f0b5318e94c0995566', 'request_id': 'req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.927333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe01d9e5d6d49f0b5318e94c0995566', 'request_id': 'req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.935603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe01d9e5d6d49f0b5318e94c0995566', 'request_id': 'req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.946914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] The token cache is being invalidate because project fbe01d9e5d6d49f0b5318e94c0995566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:39:55.947199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.947855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7cd1f0-e00c-48ca-9d7b-a367ca843b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:39:55.949599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1101/2179] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:39:55 2022] DELETE /identity/v3/projects/fbe01d9e5d6d49f0b5318e94c0995566 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:39:55.954523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:55.955074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:55.955175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:55.972384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:55.973720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:56.032452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1079/2180] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:56.040393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.040679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.040952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.060549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:56.061759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:56.070716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1102/2181] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:56.075259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.085921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd668f-092e-4be0-909c-86ae0093afed None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.090938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.091603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.091915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.092191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.093065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:39:56.093461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.094951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.106226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1080/2182] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:39:56.111173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.122817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b6528-6655-4aff-b7a4-cb1c50765649 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.129288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.130365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.130646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.130914 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.131636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.133601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.164418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1103/2183] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:39:56 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:39:56.168838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.179943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6544a-6214-4e43-976d-9475cf9408e8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.244703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.245394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.245681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.245959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.246653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.248736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.272171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1081/2184] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:39:56 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:39:56.277495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.292946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852534f0-a62c-4359-ba8b-9dadc17c52b0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.299063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.299784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.300057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.300333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.301070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.302696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.314470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1104/2185] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:56.319626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.335241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137e1e-691f-4714-9b4e-49ef362dea5e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.343311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.344102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.344378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.344653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.345384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.347038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb876fde-3bd4-4ac5-9dd1-4b197a3e7954 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.357467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1082/2186] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:39:56.362584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.373729 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cd15-b65a-4a3e-9dec-b28f7211b2da admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.379069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.379989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.380272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.380562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] PATH_INFO: `/v3/projects/323bfd19e97146e39c34d3ba12370590/users/39a6607707914d03886d6c3081cc122e/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.396768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323bfd19e97146e39c34d3ba12370590, user_id=39a6607707914d03886d6c3081cc122e, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.399473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.414271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1105/2187] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:39:56 2022] PUT /identity/v3/projects/323bfd19e97146e39c34d3ba12370590/users/39a6607707914d03886d6c3081cc122e/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:39:56.420015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e24e5-bfca-4a65-80ad-a27428b5624a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.420303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e24e5-bfca-4a65-80ad-a27428b5624a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.420579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e24e5-bfca-4a65-80ad-a27428b5624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.438377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9d7e24e5-bfca-4a65-80ad-a27428b5624a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:56.439567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9d7e24e5-bfca-4a65-80ad-a27428b5624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:56.508562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1083/2188] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:39:56.520770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:56.522622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:56.584661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f594abc-2b3f-4e6c-b1ba-8a07e9d90ba8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:56.588385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:56.589037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:56.589313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:56.589583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:56.599092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:56.600551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:56.610303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1106/2189] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:40:01.716548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:01.717099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:01.717099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:01.764647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] MFA Rules not processed for user `39a6607707914d03886d6c3081cc122e`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:01.765886 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:01.841208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1084/2190] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:01.845690 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:01.855883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa890e9-de77-4a0e-8fa3-532f0137e733 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:01.861023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:01.861741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:01.862030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:01.862306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:01.863041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:01.864982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:01.892761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1107/2191] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:40:01.898643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:01.910420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1772c-9380-45a2-80a6-c5a8f43b21b0 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:01.978391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:01.979086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:01.979410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:01.979704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:01.980592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:01.982618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:02.008051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1085/2192] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:40:01 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:40:02.012363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:02.024218 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6738e-b45d-4f66-b17b-aabb6b5c2711 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:02.033634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:02.034327 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:02.034611 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:02.034886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:02.035666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:02.037307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:02.049058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1108/2193] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:40:02.053242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:02.064652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96044dc-4ba3-4069-8c40-ea1ee0577c6c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:02.069377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:02.070457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:02.071181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:02.072724 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] PATH_INFO: `/v3/projects/f779edbfc8e041599692af4aee724c66/users/63cc093a8f3d46f0987cd51aa79d0496/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:02.089203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f779edbfc8e041599692af4aee724c66, user_id=63cc093a8f3d46f0987cd51aa79d0496, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:02.091929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:02.109655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1086/2194] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:40:02 2022] PUT /identity/v3/projects/f779edbfc8e041599692af4aee724c66/users/63cc093a8f3d46f0987cd51aa79d0496/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:40:02.113569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:02.123440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc66e79-1ee6-4826-ab4b-8874c9aa7336 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:02.178995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:02.179676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:02.179978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:02.180278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:02.181015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:02.182642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a77a4a-d62e-4a50-affc-1d1a58136a45 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:02.193479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1109/2195] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:40:02.198056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:02.209871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feed06-917c-4b3a-8048-6c2c69637e22 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:02.215607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:02.216549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:02.216993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:02.217102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] PATH_INFO: `/v3/projects/f779edbfc8e041599692af4aee724c66/users/63cc093a8f3d46f0987cd51aa79d0496/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:02.219973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f779edbfc8e041599692af4aee724c66, user_id=63cc093a8f3d46f0987cd51aa79d0496, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:02.222642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:02.237047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1087/2196] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:40:02 2022] PUT /identity/v3/projects/f779edbfc8e041599692af4aee724c66/users/63cc093a8f3d46f0987cd51aa79d0496/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:40:07.621478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47a7-66f1-431d-9ea5-8138d9a23d1d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:07.621956 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47a7-66f1-431d-9ea5-8138d9a23d1d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:07.622163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa47a7-66f1-431d-9ea5-8138d9a23d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:07.650463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3bfa47a7-66f1-431d-9ea5-8138d9a23d1d None None] MFA Rules not processed for user `63cc093a8f3d46f0987cd51aa79d0496`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:07.651925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3bfa47a7-66f1-431d-9ea5-8138d9a23d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:07.726223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1110/2197] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:40:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:07.740162 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:07.741913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:07.851188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146f8ee-33bb-4286-998d-d23174f6dc5b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:07.856877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:07.857548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:07.857877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:07.858281 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:07.917873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:07.920327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60cb7-27ec-4ed7-b4f4-e419f257fe74 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:07.931616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1088/2198] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:40:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:40:09.102161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:09.102629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:09.102736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:09.120652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] MFA Rules not processed for user `39a6607707914d03886d6c3081cc122e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:09.121882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:09.129567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1111/2199] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:40:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:11.384128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f758bd-7559-4d63-85bd-41673b9047f5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:11.384643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f758bd-7559-4d63-85bd-41673b9047f5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:11.384736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f758bd-7559-4d63-85bd-41673b9047f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:11.402999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b9f758bd-7559-4d63-85bd-41673b9047f5 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:11.404339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b9f758bd-7559-4d63-85bd-41673b9047f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:11.460182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1089/2200] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:11.472895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:11.474558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:11.549461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e669a-35fc-4af5-baab-67b780984c81 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:11.555159 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:11.555906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:11.556192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:11.556469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:11.565385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:11.566977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:11.574844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1112/2201] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:40:12.115283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09890d1a-9306-4e62-b9a2-b57c1bcd7c49 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.115642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09890d1a-9306-4e62-b9a2-b57c1bcd7c49 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.116057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09890d1a-9306-4e62-b9a2-b57c1bcd7c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.135053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-09890d1a-9306-4e62-b9a2-b57c1bcd7c49 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:12.136922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-09890d1a-9306-4e62-b9a2-b57c1bcd7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:12.145868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1090/2202] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:12.159379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:12.170401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408249f6-c326-4022-8b34-e43663a3c626 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:12.175741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:12.176439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.176725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.177001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.186318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:12.188684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:12.198083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1113/2203] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:40:12.432481 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9aeba-c360-495a-9b66-07102e755e3d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.433417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9aeba-c360-495a-9b66-07102e755e3d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.433902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9aeba-c360-495a-9b66-07102e755e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.456921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-82b9aeba-c360-495a-9b66-07102e755e3d None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:12.458180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-82b9aeba-c360-495a-9b66-07102e755e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:12.467264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1091/2204] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:12.480828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:12.491516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c4b6-6091-4552-8082-a4be138ee36e service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:12.496683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:12.497479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.498034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.498524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.507789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:12.509426 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:12.518364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1114/2205] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:40:12.868825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715dcb0-a228-4eb0-8359-a8afa974206d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.869112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715dcb0-a228-4eb0-8359-a8afa974206d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.869386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715dcb0-a228-4eb0-8359-a8afa974206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.889166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-c715dcb0-a228-4eb0-8359-a8afa974206d None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:12.890388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c715dcb0-a228-4eb0-8359-a8afa974206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:12.898448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1092/2206] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:12.914151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:12.925102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd8ea-93f4-4066-bca6-9b984c9926cc service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:12.930805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:12.931445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:12.931749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:12.932025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:12.940139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:12.941753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:12.951287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1115/2207] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:40:14.947053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8a71-499b-4902-b68d-d8e9b3e153f2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:14.947569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8a71-499b-4902-b68d-d8e9b3e153f2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:14.947662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8a71-499b-4902-b68d-d8e9b3e153f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:14.969581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ed5d8a71-499b-4902-b68d-d8e9b3e153f2 None None] MFA Rules not processed for user `99075fda1c7d4e7698e2062407bc2433`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:14.970887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ed5d8a71-499b-4902-b68d-d8e9b3e153f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:15.036313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1093/2208] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:40:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:15.085613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:15.087916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:15.153204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce13a-d2b7-4933-a97d-55593e2770f7 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:15.158550 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:15.159509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:15.159860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:15.160194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] PATH_INFO: `/v3/users/a77a9da6c6f74aa3b9e58a1d1b84d14b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:15.161424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77a9da6c6f74aa3b9e58a1d1b84d14b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:15.163486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:15.212164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77a9da6c6f74aa3b9e58a1d1b84d14b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.224161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77a9da6c6f74aa3b9e58a1d1b84d14b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.230816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77a9da6c6f74aa3b9e58a1d1b84d14b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.232219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77a9da6c6f74aa3b9e58a1d1b84d14b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.241016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77a9da6c6f74aa3b9e58a1d1b84d14b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.247223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1116/2209] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:40:15 2022] DELETE /identity/v3/users/a77a9da6c6f74aa3b9e58a1d1b84d14b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:40:15.252121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:15.252407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:15.252681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:15.271703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:40:15.272908 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:15.333338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1094/2210] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:40:15.343100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:15.344602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:15.404120 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e19a3-9c39-4483-9ce3-7d3fa7e13f92 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:15.409348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:15.410020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:15.410298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:15.410567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:15.420863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:15.422400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:15.433612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1117/2211] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:40:15.676601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:15.679554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:15.698154 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cc1df-c32f-4566-b54d-6290e8c72bc8 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:15.713402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:15.714306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:15.714586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:15.714862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] PATH_INFO: `/v3/projects/eb08ec33a1c8431bbe1464d11be9bfc6` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:15.717331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb08ec33a1c8431bbe1464d11be9bfc6)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:15.718803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:15.783591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'request_id': 'req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.791421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'request_id': 'req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.801970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb08ec33a1c8431bbe1464d11be9bfc6', 'request_id': 'req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.814566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] The token cache is being invalidate because project eb08ec33a1c8431bbe1464d11be9bfc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:40:15.814904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.815573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9ac4f325-ce4a-4bf8-b3ab-ab2791756be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:40:15.817503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1095/2212] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:40:15 2022] DELETE /identity/v3/projects/eb08ec33a1c8431bbe1464d11be9bfc6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:40:46.616315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:46.617829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:46.714883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd18aa-7268-43b1-a4c0-f60dedb39e65 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:46.777849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:46.778509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:46.778789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:46.779054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:46.781032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:46.792137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:46.794091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:46.803876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1118/2213] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:08.556805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c732d-f9c5-4b8e-be4b-98074f8da708 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:08.557408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c732d-f9c5-4b8e-be4b-98074f8da708 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:08.557408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c732d-f9c5-4b8e-be4b-98074f8da708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:08.575542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5a9c732d-f9c5-4b8e-be4b-98074f8da708 None None] MFA Rules not processed for user `691afedb8d7c4ae3a69843fe6198c210`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:08.576761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5a9c732d-f9c5-4b8e-be4b-98074f8da708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:08.633527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1096/2214] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:20.830202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:20.831784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:20.894640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94253-e64e-4526-b315-1e54ea55dc5e service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:20.899282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:20.899970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:20.900244 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:20.900535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:20.902692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:20.964587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:20.966018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:20.975439 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1119/2215] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:46.358681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e97f2-a0d9-47b9-8445-4eef22fe29d3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:46.359508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e97f2-a0d9-47b9-8445-4eef22fe29d3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:46.359508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e97f2-a0d9-47b9-8445-4eef22fe29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:46.417072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-252e97f2-a0d9-47b9-8445-4eef22fe29d3 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:46.418701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-252e97f2-a0d9-47b9-8445-4eef22fe29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:46.488358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1097/2216] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:46.544185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:46.545798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:46.636154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec22b9-7fe3-46f9-adef-732ba012bed2 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:46.641396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:46.642050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:46.642334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:46.642613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:46.651260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:46.652944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bebac-588f-481f-8604-14b4ba413bc4 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:46.660852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1120/2217] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:42:04.001574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.002167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.002167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.003608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1098/2218] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:42:04.010230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e0cc-debf-4d48-beae-f6d3ed05616b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.010715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e0cc-debf-4d48-beae-f6d3ed05616b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.010930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e0cc-debf-4d48-beae-f6d3ed05616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.054466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0fe4e0cc-debf-4d48-beae-f6d3ed05616b None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:04.056026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0fe4e0cc-debf-4d48-beae-f6d3ed05616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:04.131079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1121/2219] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:04.143330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:04.145398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:04.227668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7af6b-bb6e-4631-a33e-f84f689620ad None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:04.232309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:04.233001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.233287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.233561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.245664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:04.247197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6171f36-4d15-4b43-8012-ea39a69105a2 service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:04.260252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1099/2220] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:42:04.333363 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b7-752d-442e-abf2-aa379e27313e None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.333648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b7-752d-442e-abf2-aa379e27313e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.333919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b7-752d-442e-abf2-aa379e27313e None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.335404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1122/2221] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:42:04.340333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751327e-09bd-403e-ada4-457734fb91e8 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.340692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751327e-09bd-403e-ada4-457734fb91e8 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.341034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751327e-09bd-403e-ada4-457734fb91e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.359935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8751327e-09bd-403e-ada4-457734fb91e8 None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:04.361142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8751327e-09bd-403e-ada4-457734fb91e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:04.367863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1100/2222] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:04.380251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba48b7-752d-442e-abf2-aa379e27313e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:04.391182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba48b7-752d-442e-abf2-aa379e27313e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:04.394678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:04.395326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.395645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.395937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.403337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:04.404812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdd086-da28-445d-abc8-db8126c3f363 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:04.412587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1123/2223] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:04.497313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b247-462b-48e6-bdfc-f084b23d1f5c None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.497603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b247-462b-48e6-bdfc-f084b23d1f5c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.497882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b247-462b-48e6-bdfc-f084b23d1f5c None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.499282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1101/2224] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:42:04.505577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9eb28-5ebe-47d6-ad9d-120c1a8d1cda None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.505805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9eb28-5ebe-47d6-ad9d-120c1a8d1cda None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.506382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9eb28-5ebe-47d6-ad9d-120c1a8d1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.525374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9fa9eb28-5ebe-47d6-ad9d-120c1a8d1cda None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:04.526940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9fa9eb28-5ebe-47d6-ad9d-120c1a8d1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:04.537447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1124/2225] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:04.550984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b247-462b-48e6-bdfc-f084b23d1f5c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:04.562981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b247-462b-48e6-bdfc-f084b23d1f5c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:04.566934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:04.567587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:04.568216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:04.568643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:04.581073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:04.582812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bced5-da85-4668-ad03-6d5789ead20e service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:04.595461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1102/2226] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:05.840775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:05.841485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:05.841485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:05.859185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] MFA Rules not processed for user `ab522f0209154f959a431caa01f3a029`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:05.860473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:05.919953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1125/2227] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:10.473543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:10.474108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:10.479783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:10.519123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:10.520423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:10.538593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1103/2228] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:10.553025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:10.566132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eca54-03c7-4645-9908-e56255371ab3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:10.571744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880611-f169-475a-a133-10868e9460f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:10.572405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880611-f169-475a-a133-10868e9460f2 service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:10.572689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880611-f169-475a-a133-10868e9460f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:10.572965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880611-f169-475a-a133-10868e9460f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:10.584092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880611-f169-475a-a133-10868e9460f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:10.585737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880611-f169-475a-a133-10868e9460f2 service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:10.603350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1126/2229] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:42:29.230104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:29.231923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:29.248791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c9f5-436d-468a-9f35-a013221bb2a3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:29.253902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:29.254559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:29.254858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:29.255110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:29.257246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:29.271019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:29.272488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:29.283477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1104/2230] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:30.976928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880611-f169-475a-a133-10868e9460f2 service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:30.987609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880611-f169-475a-a133-10868e9460f2 service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:30.991918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:30.992660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:30.992941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:30.993210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:30.995228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:31.010854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:31.012361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:31.023889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1127/2231] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:42.414763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:42.416504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:42.430928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306a89-cc5d-4c47-acc3-bf2d2e26dea5 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:42.437722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:42.438412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:42.438693 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:42.438966 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:42.441104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:42.452164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:42.453856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:42.463421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1105/2232] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:42.808727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:42.820609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:42.899262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1aa8-24da-4248-9d87-a656cdbcb91f service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:42.905689 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:42.906584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:42.906856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:42.907126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] PATH_INFO: `/v3/users/691afedb8d7c4ae3a69843fe6198c210` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:42.908360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691afedb8d7c4ae3a69843fe6198c210)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:42.910353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:42.959942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691afedb8d7c4ae3a69843fe6198c210'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:42.972136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691afedb8d7c4ae3a69843fe6198c210'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:42.980738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691afedb8d7c4ae3a69843fe6198c210'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:42.981543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691afedb8d7c4ae3a69843fe6198c210'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:42.989930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691afedb8d7c4ae3a69843fe6198c210'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:42.997624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1128/2233] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:42:42 2022] DELETE /identity/v3/users/691afedb8d7c4ae3a69843fe6198c210 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:43.174467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:43.185808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8c53-133a-45de-be66-9eedab9061c4 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:43.242267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:43.243146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:43.243425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:43.243914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] PATH_INFO: `/v3/projects/ec6ea995239c47df80dd8c7ff0aa23f3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:43.245743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6ea995239c47df80dd8c7ff0aa23f3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:43.247974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:43.297236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'request_id': 'req-8361e3aa-69a6-4eec-ae95-f910fcfc0773'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:43.302715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'request_id': 'req-8361e3aa-69a6-4eec-ae95-f910fcfc0773'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:43.312030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6ea995239c47df80dd8c7ff0aa23f3', 'request_id': 'req-8361e3aa-69a6-4eec-ae95-f910fcfc0773'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:43.323304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] The token cache is being invalidate because project ec6ea995239c47df80dd8c7ff0aa23f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:42:43.323587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:43.324367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8361e3aa-69a6-4eec-ae95-f910fcfc0773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:43.325927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1106/2234] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:42:43 2022] DELETE /identity/v3/projects/ec6ea995239c47df80dd8c7ff0aa23f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:48.745673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:48.747122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:48.809123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910fd2a-831f-4426-9be0-4a28c72bd2d2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:48.875469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:48.876215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:48.876495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:48.876770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:48.878843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:48.888370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:48.889819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:48.898131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1129/2235] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:49.684061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:49.684547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:49.684662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:49.703050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:49.704464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:49.761602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1107/2236] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:49.785971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:49.787506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:49.861507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a079b6-a57a-4033-836a-bc8c46b51917 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:49.867846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:49.868502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:49.868779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:49.869045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:49.877483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:49.879162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:49.887142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1130/2237] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:42:51.373041 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:51.375762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:51.463988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e33d-20db-4c5f-882f-24567412dc4b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:51.470932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:51.471589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:51.471899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:51.472177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:51.474575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:51.539052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:51.540691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de85da-a4c9-42d4-88af-af6f35401885 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:51.553036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1108/2238] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:42:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:21.451200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:21.452854 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:21.469814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b903-a9df-476d-8655-ba7703cd3e5a service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:21.478202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:21.478875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:21.479153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:21.479424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:21.481699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:21.543863 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:21.545462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:21.554405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1131/2239] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:58.231628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:58.232269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:58.232269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:58.253765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] MFA Rules not processed for user `99075fda1c7d4e7698e2062407bc2433`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:58.255113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:58.263938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1109/2240] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:04.775156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:04.786537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1c0a-7b27-429c-883a-edcabf9aed5a service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.793714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.794376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.794654 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.794927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.796861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.809467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.811063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907130e2-480a-4351-96e8-bd437127e74b service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.821915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1132/2241] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:15.341030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:15.360751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3712a3-da8b-4070-a4cb-4e7b14ae926c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:15.367290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:15.367990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:15.368277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:15.368557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:15.370579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:15.432573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:15.434347 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:15.443722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1110/2242] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:32.967909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:32.968454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:32.968454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:32.989571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] MFA Rules not processed for user `f7b41d1655e24cf0b1f4bda137115af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:32.991273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:33.000545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1133/2243] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:44:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:33.358346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:33.360035 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:33.372603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40960f3-2e40-418a-a1f7-2290567b83fc service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:33.376699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:33.377367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:33.377650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:33.377926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:33.380057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:33.390623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:33.392094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309263b0-8acd-4ca7-bba4-bd2a0c0ad3e7 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:33.400504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1111/2244] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:34.742678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:34.744092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:34.823018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32852c-1209-4de8-b536-026cdd3fefab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:34.828396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:34.829062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:34.829337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:34.829604 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:34.831603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:34.844110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:34.845719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baad21a-ac47-4941-a2ec-fc6f0bc02f9e service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:34.856127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1134/2245] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:42.650657 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.651223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.651223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] PATH_INFO: `/` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.652665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1112/2246] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:44:42.658631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee9e5-1e1b-489a-8a27-7bde9a139973 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.659126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee9e5-1e1b-489a-8a27-7bde9a139973 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.659295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee9e5-1e1b-489a-8a27-7bde9a139973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.679165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b15ee9e5-1e1b-489a-8a27-7bde9a139973 None None] MFA Rules not processed for user `cedef275f3404a3c8e618cb48f2afc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:42.680408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b15ee9e5-1e1b-489a-8a27-7bde9a139973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:42.687296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1135/2247] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:42.699850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:42.701994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:42.716641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda499c7-0197-44d1-bb90-574756d21c01 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:42.721014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:42.722015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.722376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.722688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.730151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:42.731580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab12a4-7115-43e3-ab59-35e80167fc5a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:42.739622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1113/2248] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:42.827638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d626-facb-4082-9617-f3a0a97fb31f None None] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.828174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d626-facb-4082-9617-f3a0a97fb31f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.829204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5d626-facb-4082-9617-f3a0a97fb31f None None] PATH_INFO: `/` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.831028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1136/2249] 10.222.0.79 () {54 vars in 921 bytes} [Thu May 12 14:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:44:42.837429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876007c3-b381-451c-8324-37decebe5c30 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.837720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876007c3-b381-451c-8324-37decebe5c30 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.837981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876007c3-b381-451c-8324-37decebe5c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.857090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-876007c3-b381-451c-8324-37decebe5c30 None None] MFA Rules not processed for user `e2801984340040c499b17ef6e0324033`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:42.858283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-876007c3-b381-451c-8324-37decebe5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:42.868174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1114/2250] 10.222.0.79 () {58 vars in 1018 bytes} [Thu May 12 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:42.878885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5d626-facb-4082-9617-f3a0a97fb31f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:42.889951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5d626-facb-4082-9617-f3a0a97fb31f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:42.893740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:42.894366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:42.894652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:42.894923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:42.905189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:42.906614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404fce4-c63e-4869-bc7e-372d36863689 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:42.917571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1137/2251] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:45.460149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876007c3-b381-451c-8324-37decebe5c30 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:45.479204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876007c3-b381-451c-8324-37decebe5c30 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:45.484851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:45.485519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:45.485796 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:45.486076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:45.488066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:45.503266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:45.505012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:45.516092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1115/2252] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:44:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:04.568720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:04.569335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:04.569335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:04.588095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] MFA Rules not processed for user `ab522f0209154f959a431caa01f3a029`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:04.589359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:04.645452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1138/2253] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:22.259325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:22.273427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bdc3-95cb-4dcc-9fef-0b19964e5b8f service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:22.283117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:22.284553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:22.285004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:22.285611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:22.289076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:22.304016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:22.306048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:22.318029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1116/2254] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:30.324722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:30.335114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77db95-4b35-4c88-8093-804d609daec4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:30.339553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:30.340234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:30.340511 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:30.340811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:30.343055 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:30.410180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:30.411850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:30.422486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1139/2255] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:34.215015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:34.216574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:34.233546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3e11-8851-4c35-b5a7-8bc64bc574a6 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:34.240563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:34.241451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.241728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.241997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] PATH_INFO: `/v3/users/99075fda1c7d4e7698e2062407bc2433` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.243341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99075fda1c7d4e7698e2062407bc2433)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:34.245315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:34.296191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99075fda1c7d4e7698e2062407bc2433'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.307577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99075fda1c7d4e7698e2062407bc2433'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.308208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99075fda1c7d4e7698e2062407bc2433'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.308808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99075fda1c7d4e7698e2062407bc2433'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.319365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-030d6e97-5a1a-4a77-b703-0b7bcf7d9f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99075fda1c7d4e7698e2062407bc2433'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.333736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1117/2256] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:34 2022] DELETE /identity/v3/users/99075fda1c7d4e7698e2062407bc2433 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:34.510336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:34.524537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e31d-6d43-49f2-87a4-3b2746751f8f service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:34.587466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:34.588391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.588672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.588950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] PATH_INFO: `/v3/projects/2580eb79c9684c318adbfaa325e7f12c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.590217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2580eb79c9684c318adbfaa325e7f12c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:34.592178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:34.648510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2580eb79c9684c318adbfaa325e7f12c', 'request_id': 'req-97367de9-d2e5-4554-a284-8fa12ccce55c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.654494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2580eb79c9684c318adbfaa325e7f12c', 'request_id': 'req-97367de9-d2e5-4554-a284-8fa12ccce55c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.663881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2580eb79c9684c318adbfaa325e7f12c', 'request_id': 'req-97367de9-d2e5-4554-a284-8fa12ccce55c'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.676535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] The token cache is being invalidate because project 2580eb79c9684c318adbfaa325e7f12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:34.676813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.677575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-97367de9-d2e5-4554-a284-8fa12ccce55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:34.679251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1140/2257] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:34 2022] DELETE /identity/v3/projects/2580eb79c9684c318adbfaa325e7f12c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:45:34.689792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.690188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.690557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.710024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:34.711378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:34.773060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1118/2258] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:34.780742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.781023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.781299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.800990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:34.802319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:34.811495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1141/2259] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:34.815790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:34.828398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31827936-c7c2-46b1-b358-b9906df67469 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:34.835214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:34.835923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.836210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.836487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.837240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:34.837548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:34.839178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:34.851307 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1119/2260] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:34.855901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:34.865438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9975f-a17f-4a35-947b-428f81d9d3d3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:34.870852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:34.871504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.871822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.872095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.872786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:34.874694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:34.919281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1142/2261] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:34 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:34.924507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:34.935562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91e04-2da5-4734-9dfe-f3d9808b9aea admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:34.994825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:34.995467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:34.995826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:34.996101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:34.996794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:34.998741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.021641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1120/2262] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:34 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:35.027734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.038868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995f7c-d10f-4fac-821f-5a631464006d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.044616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.045343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.045650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.045930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.046663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.048303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.059096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1143/2263] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:35.064594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.075586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5231d3-be03-4689-869a-9208e0811406 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.081344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.082009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.082290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.082637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.083591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.085244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cf9d1-fbe7-4e6d-a0cf-98f2d544abac admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.097211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1121/2264] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:35.101540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.111477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f88c-e7e8-4785-b750-22d61b9accb7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.116750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.117707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.118080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.118391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] PATH_INFO: `/v3/projects/113cd4674ad341499c6dcad8534bea80/users/006d840098614efc8194394e304b7259/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.136649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113cd4674ad341499c6dcad8534bea80, user_id=006d840098614efc8194394e304b7259, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.139316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.154130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1144/2265] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:35 2022] PUT /identity/v3/projects/113cd4674ad341499c6dcad8534bea80/users/006d840098614efc8194394e304b7259/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:45:35.164833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.165121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.165399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.192926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] MFA Rules not processed for user `006d840098614efc8194394e304b7259`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:35.194117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:35.263610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1122/2266] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:35.268977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.345517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1db1-599c-4c80-9c87-fa5de0765924 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.352268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.352942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.353223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.353494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.354193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.356145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.390431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1145/2267] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:35 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:35.394930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.406999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19921c-56c0-433b-b839-820a44efd8bb None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.465288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.465962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.466256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.466534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.467253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.469227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.495453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1123/2268] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:35 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:35.499628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.511641 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fb04-88da-46ec-9f53-3e2617dadebb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.519100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.520799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.521213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.521686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.523033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.526001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.538680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1146/2269] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:45:35.544956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.556789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f1db-d184-47fc-94b5-1e8eb0993b6d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.562016 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.562920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.563199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.563475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] PATH_INFO: `/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59/users/e5192bce38e6497bae4e2eefdab601d4/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.579846 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8dfde4adc6d4e18abfb0c39c733bb59, user_id=e5192bce38e6497bae4e2eefdab601d4, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.582561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.601277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1124/2270] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:35 2022] PUT /identity/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59/users/e5192bce38e6497bae4e2eefdab601d4/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:35.607235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.620495 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e17e2-cec6-42e2-8118-a88a9ecc3a0a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.677472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.678147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.678433 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.678709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.679428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.681069 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594397-6acc-4982-8068-82a480c74ae5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.690575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1147/2271] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:35.696661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.711326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cc67-feed-4361-9dff-e2949051c7b0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.717356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3157a-f956-454c-a890-373512615755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.718285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3157a-f956-454c-a890-373512615755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.718566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3157a-f956-454c-a890-373512615755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.718842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3157a-f956-454c-a890-373512615755 admin admin] PATH_INFO: `/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59/users/e5192bce38e6497bae4e2eefdab601d4/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.721165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3157a-f956-454c-a890-373512615755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8dfde4adc6d4e18abfb0c39c733bb59, user_id=e5192bce38e6497bae4e2eefdab601d4, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.724099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3157a-f956-454c-a890-373512615755 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.735413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1125/2272] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:35 2022] PUT /identity/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59/users/e5192bce38e6497bae4e2eefdab601d4/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:35.746708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.747005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.747313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.774275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] MFA Rules not processed for user `e5192bce38e6497bae4e2eefdab601d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:35.775481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:35.849576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1148/2273] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:45:35.860415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3157a-f956-454c-a890-373512615755 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:35.862167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-abc3157a-f956-454c-a890-373512615755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:35.950169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3157a-f956-454c-a890-373512615755 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:35.954704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:35.955373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:35.955647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:35.955950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:35.965424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:35.966858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be965-8525-4199-bf1f-93fd3c9253bb service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:35.976293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1126/2274] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:36.127638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:36.199862 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c314f1-f18a-4110-a08d-fcd90c22294f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:36.204785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:36.205644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:36.205926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:36.206200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] PATH_INFO: `/v3/users/006d840098614efc8194394e304b7259` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:36.207420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=006d840098614efc8194394e304b7259)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:36.210017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:36.260524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006d840098614efc8194394e304b7259'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:36.272229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006d840098614efc8194394e304b7259'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:36.278857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006d840098614efc8194394e304b7259'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:36.279596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006d840098614efc8194394e304b7259'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:36.288523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006d840098614efc8194394e304b7259'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:36.295090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1149/2275] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:36 2022] DELETE /identity/v3/users/006d840098614efc8194394e304b7259 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:36.299856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:36.300379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:36.300540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:36.317924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:36.319222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:36.377731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1127/2276] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:36.388285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:36.389755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:36.449099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3852b-3e61-4641-aac4-4d38690abfae admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:36.453158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:36.453831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:36.454133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:36.454395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:36.464110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:36.465541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:36.475177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1150/2277] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:36.957302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:36.959909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:36.975417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f800b8-e5d6-4e40-9eca-f66e8586c2f3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:36.981580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:36.982840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:36.983459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:36.983915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] PATH_INFO: `/v3/projects/113cd4674ad341499c6dcad8534bea80` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:36.985508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=113cd4674ad341499c6dcad8534bea80)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:36.987609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.035185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113cd4674ad341499c6dcad8534bea80', 'request_id': 'req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.041070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113cd4674ad341499c6dcad8534bea80', 'request_id': 'req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.051832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113cd4674ad341499c6dcad8534bea80', 'request_id': 'req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.063247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] The token cache is being invalidate because project 113cd4674ad341499c6dcad8534bea80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:37.063536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.064224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.065822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1128/2278] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:36 2022] DELETE /identity/v3/projects/113cd4674ad341499c6dcad8534bea80 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:37.069952 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:37.079402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acdc1-faab-4b4d-8154-752ce7a239e8 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:37.137325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:37.138242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.138523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.138793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] PATH_INFO: `/v3/users/e5192bce38e6497bae4e2eefdab601d4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.140050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5192bce38e6497bae4e2eefdab601d4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:37.141982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.197798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5192bce38e6497bae4e2eefdab601d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.209519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5192bce38e6497bae4e2eefdab601d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.216012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5192bce38e6497bae4e2eefdab601d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.216757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5192bce38e6497bae4e2eefdab601d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.226847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-735522e7-9c41-4667-b33b-4e0d3b11967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5192bce38e6497bae4e2eefdab601d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.236328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1151/2279] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:37 2022] DELETE /identity/v3/users/e5192bce38e6497bae4e2eefdab601d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:37.517935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:37.519710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:37.533038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356a66-bdf7-4da0-9bae-a7645cc22b7c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:37.596385 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:37.597264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.597540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.597818 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] PATH_INFO: `/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.599388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8dfde4adc6d4e18abfb0c39c733bb59)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:37.601353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.656776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8dfde4adc6d4e18abfb0c39c733bb59', 'request_id': 'req-37904ddf-be6d-43ac-8320-c69f9dbe9911'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.663802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8dfde4adc6d4e18abfb0c39c733bb59', 'request_id': 'req-37904ddf-be6d-43ac-8320-c69f9dbe9911'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.673645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8dfde4adc6d4e18abfb0c39c733bb59', 'request_id': 'req-37904ddf-be6d-43ac-8320-c69f9dbe9911'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.684604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] The token cache is being invalidate because project f8dfde4adc6d4e18abfb0c39c733bb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:37.684891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.685522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-37904ddf-be6d-43ac-8320-c69f9dbe9911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:37.687072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1129/2280] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:37 2022] DELETE /identity/v3/projects/f8dfde4adc6d4e18abfb0c39c733bb59 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:37.692352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.692636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.692912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.710974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:37.712208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:37.772677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1152/2281] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:37.780407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.780697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.780977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.799972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:37.801176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:37.809782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1130/2282] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:37.814315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:37.825950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e318a-c6fd-4904-a84f-f51ca4d9a8eb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:37.834285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:37.834992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.835277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.835555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.836326 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:37.836636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:37.838273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.850716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1153/2283] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:37.855099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:37.864495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e76d-bf4d-4389-a28c-94c8e8f1a0ad None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:37.869398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:37.870098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.870371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.870643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.871332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:37.873263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.903494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1131/2284] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:37 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:37.904876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:37.915085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da077-96e7-4045-8002-05bbe7165867 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:37.973441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:37.974064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:37.974332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:37.974607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:37.975290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:37.977417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:37.998383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1154/2285] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:37 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:38.002776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.013318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a46b-7db6-48af-92c0-6f7dc25863a5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.018031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.018733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.018983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.019261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.020300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.021662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.033421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1132/2286] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:38.037697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.048517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052eb35-9c9e-4778-a4b4-708bf6587ee5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.053934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.054616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.054898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.056451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.056451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.057539 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468875e7-c410-4585-8ba8-7cf1e1f33f41 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.068516 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1155/2287] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:38.072895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.085535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c93dac-6522-4090-a2d3-98fb4ff3f7dc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.090850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.091830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.092114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.092391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] PATH_INFO: `/v3/projects/8fadbba303c44fb697a603094b11d83f/users/1328afcdfbf642a98b0ed8b601f764be/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.107428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fadbba303c44fb697a603094b11d83f, user_id=1328afcdfbf642a98b0ed8b601f764be, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.110180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.126493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1133/2288] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:38 2022] PUT /identity/v3/projects/8fadbba303c44fb697a603094b11d83f/users/1328afcdfbf642a98b0ed8b601f764be/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:38.138303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.138875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.138875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.167012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] MFA Rules not processed for user `1328afcdfbf642a98b0ed8b601f764be`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:38.168213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:38.230974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1156/2289] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:45:38.235774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.297702 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b7d5-5bd3-4e36-a7cd-e88a8d2aef6e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.302747 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.303414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.303708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.304002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.304703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.306678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.336454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1134/2290] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:38 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:38.340760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.351631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e2051-5174-4d68-9cdc-6fed33d885bf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.408846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.409810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.410211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.410955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.411655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.413631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.436294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1157/2291] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:38 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:38.442483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.453314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8d7b1-4ebd-408d-be23-58603fd3659d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.459083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.459796 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.460077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.460348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.461082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.462698 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.473986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1135/2292] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:38.478206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.489067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf853a7-cf30-4a2e-8b99-ded2f82623bb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.499617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.500620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.500902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.501180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] PATH_INFO: `/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2/users/86c472fa9c2b44dca4ed70d662531776/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.518057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ea550cbd8f48f6bb8a98b7e78eaaa2, user_id=86c472fa9c2b44dca4ed70d662531776, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.520923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.537682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1158/2293] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:38 2022] PUT /identity/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2/users/86c472fa9c2b44dca4ed70d662531776/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:38.543550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.554072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a589a32-0497-4a87-b6bf-a1a6da679552 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.610025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.610700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.610982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.611254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.612011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.613647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28a2b-56f1-4a24-a575-56929b4f0f46 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.624254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1136/2294] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:38.630699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.647059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961ac3-b58f-4b29-840f-adc2e281921c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.652683 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.653601 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.653877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.654143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] PATH_INFO: `/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2/users/86c472fa9c2b44dca4ed70d662531776/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.656377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ea550cbd8f48f6bb8a98b7e78eaaa2, user_id=86c472fa9c2b44dca4ed70d662531776, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.659097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.670371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1159/2295] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:38 2022] PUT /identity/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2/users/86c472fa9c2b44dca4ed70d662531776/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:38.680648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.680938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.681225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.708732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] MFA Rules not processed for user `86c472fa9c2b44dca4ed70d662531776`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:38.709986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:38.780477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1137/2296] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:45:38.792343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:38.794330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:38.854097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958089-bfbf-47ed-bd8d-864c8b689da6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:38.858643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:38.859292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:38.859575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:38.859883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:38.869804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:38.871241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228df07-6f36-4486-97e1-ec736822372c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:38.880986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1160/2297] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:38.947125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:39.017645 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc5d0-0b4c-4d2c-b3ab-24d3e6ebdd3c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:39.023274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:39.024272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:39.024549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:39.024819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] PATH_INFO: `/v3/users/1328afcdfbf642a98b0ed8b601f764be` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:39.026139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1328afcdfbf642a98b0ed8b601f764be)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:39.028106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:39.081218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1328afcdfbf642a98b0ed8b601f764be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.093916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1328afcdfbf642a98b0ed8b601f764be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.094696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1328afcdfbf642a98b0ed8b601f764be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.095437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1328afcdfbf642a98b0ed8b601f764be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.106026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1328afcdfbf642a98b0ed8b601f764be'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.124383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1138/2298] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:38 2022] DELETE /identity/v3/users/1328afcdfbf642a98b0ed8b601f764be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:39.130388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:39.130800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:39.131299 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:39.149775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:39.150983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:39.224359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1161/2299] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:39.235099 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:39.237496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:39.305709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f86d-042f-432b-a428-fe608e1119ea admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:39.310493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:39.311157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:39.311449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:39.311731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:39.321549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:39.322993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:39.333953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1139/2300] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:39.617811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:39.619268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:39.633386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f362ceb-103a-4d8b-b3f7-70a2ee83363c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:39.638831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:39.639922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:39.640302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:39.640682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] PATH_INFO: `/v3/projects/8fadbba303c44fb697a603094b11d83f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:39.642316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fadbba303c44fb697a603094b11d83f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:39.644776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:39.696335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fadbba303c44fb697a603094b11d83f', 'request_id': 'req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.701875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fadbba303c44fb697a603094b11d83f', 'request_id': 'req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.710886 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fadbba303c44fb697a603094b11d83f', 'request_id': 'req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.721970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] The token cache is being invalidate because project 8fadbba303c44fb697a603094b11d83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:39.722256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.722888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.724498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1162/2301] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:39 2022] DELETE /identity/v3/projects/8fadbba303c44fb697a603094b11d83f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:39.728728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:39.739109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05eb4b-1b0a-450e-a27d-50f0fc089241 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:39.797733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:39.798609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:39.798885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:39.799157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] PATH_INFO: `/v3/users/86c472fa9c2b44dca4ed70d662531776` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:39.800418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c472fa9c2b44dca4ed70d662531776)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:39.802364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:39.854853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c472fa9c2b44dca4ed70d662531776'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.867208 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c472fa9c2b44dca4ed70d662531776'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.867808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c472fa9c2b44dca4ed70d662531776'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.868417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c472fa9c2b44dca4ed70d662531776'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.877893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59679191-72ce-4a66-bef0-a4e553419929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c472fa9c2b44dca4ed70d662531776'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:39.891703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1140/2302] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:39 2022] DELETE /identity/v3/users/86c472fa9c2b44dca4ed70d662531776 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:40.180728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.182202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:40.195571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b6ad1-ce9d-47e8-bed4-a9e066f2bba9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.260960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.261861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.262148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.262431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] PATH_INFO: `/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.263720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ea550cbd8f48f6bb8a98b7e78eaaa2)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.265681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.325783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ea550cbd8f48f6bb8a98b7e78eaaa2', 'request_id': 'req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:40.334008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ea550cbd8f48f6bb8a98b7e78eaaa2', 'request_id': 'req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:40.342973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ea550cbd8f48f6bb8a98b7e78eaaa2', 'request_id': 'req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:40.354295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] The token cache is being invalidate because project c8ea550cbd8f48f6bb8a98b7e78eaaa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:40.354567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:40.355260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a18d97f6-a95d-467d-8565-ddf7dd7a1c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:40.356901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1163/2303] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:40 2022] DELETE /identity/v3/projects/c8ea550cbd8f48f6bb8a98b7e78eaaa2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:40.363573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.363900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.364204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.385362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:40.386504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:40.453139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1141/2304] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:40.461257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.461573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.461847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.482428 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:40.483644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:40.492714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1164/2305] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:40.497226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.507665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bca5e-911b-4dd9-a822-e57efd6560c6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.513546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.514217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.514496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.514767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.515501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:40.515842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.517460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.529434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1142/2306] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:40.533815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.543995 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369f8c-3caa-4ed1-83f6-caaba6bd9563 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.549294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.549950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.550228 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.550498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.551190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.553234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.580984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1165/2307] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:40.587339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.601959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a44fe-8f70-418e-b68a-02ad11b3cd56 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.664402 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.665001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.665254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.665536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.666577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.668535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.695286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1143/2308] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:45:40.699627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.710257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca411e-1935-4266-95d6-71f98be8b7dd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.715398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.716088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.716370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.716649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.717374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.718981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.729744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1166/2309] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:40.734032 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.744532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e315556-03d5-4c62-bf57-431a4e11d1ba admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.749641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.750344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.750607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.750877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.751600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.753229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7b94-a6ea-4802-9db9-e7ca4468757c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.762936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1144/2310] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:45:40.767205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:40.777603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894cda-1757-4724-ba92-cdada8c994b6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:40.784263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:40.785134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.785409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.785680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] PATH_INFO: `/v3/projects/6c50825f415e47468c495eaf9c682620/users/2970d465312b495d809629247d1712fd/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.802071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c50825f415e47468c495eaf9c682620, user_id=2970d465312b495d809629247d1712fd, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:40.804899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:40.820707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1167/2311] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:40 2022] PUT /identity/v3/projects/6c50825f415e47468c495eaf9c682620/users/2970d465312b495d809629247d1712fd/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:40.832096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:40.832369 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:40.832647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:40.859712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] MFA Rules not processed for user `2970d465312b495d809629247d1712fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:40.860947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:40.930885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1145/2312] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:40.936044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.018273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf6e6-797b-4715-bdd7-aeb301a72635 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.023444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.024354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.024640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.024921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.025616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.027546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.057979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1168/2313] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:40 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:41.062330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.073961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070cc84-9701-4d41-8975-57030466aad2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.129584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.130250 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.130526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.130798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.131484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.133493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.154269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1146/2314] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:41 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:41.158222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.168964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d168d3-2858-46a2-88cf-b1ee5f87e0c3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.173691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.174353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.174629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.174897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.175596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.177221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.187860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1169/2315] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:41.192004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.202494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3538d5-ae28-4af8-bd7d-a8fc57821113 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.208384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.209278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.209554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.209822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] PATH_INFO: `/v3/projects/ee5033bafe454094903ea84e7fdbd5e0/users/dc5082f026494284a8c8ae982d42a282/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.225331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5033bafe454094903ea84e7fdbd5e0, user_id=dc5082f026494284a8c8ae982d42a282, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.228092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.244644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1147/2316] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:41 2022] PUT /identity/v3/projects/ee5033bafe454094903ea84e7fdbd5e0/users/dc5082f026494284a8c8ae982d42a282/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:41.248704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.259057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4350a-fc45-4b23-85a1-0b8359d81f77 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.317165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.317837 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.318123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.318398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.319127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.320870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad55c-5e3d-4e6d-9a88-17d0c2e40478 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.330783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1170/2317] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:41.336989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.348064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ea0f6-2c72-44dd-99f9-e4d657181538 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.354187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.355233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.355516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.355828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] PATH_INFO: `/v3/projects/ee5033bafe454094903ea84e7fdbd5e0/users/dc5082f026494284a8c8ae982d42a282/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.358134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5033bafe454094903ea84e7fdbd5e0, user_id=dc5082f026494284a8c8ae982d42a282, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.360852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.371905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1148/2318] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:41 2022] PUT /identity/v3/projects/ee5033bafe454094903ea84e7fdbd5e0/users/dc5082f026494284a8c8ae982d42a282/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:41.382310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.382676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.383117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.410861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] MFA Rules not processed for user `dc5082f026494284a8c8ae982d42a282`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:41.412109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:41.482866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1171/2319] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:41.494638 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:41.497028 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:41.561531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd55e9-755e-4ae9-bab2-cc53d43d07cf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:41.565762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:41.566427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:41.566734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:41.567029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:41.577304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:41.578802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8796e-4842-41a1-8ea8-65c0ca0a954e service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:41.588778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1149/2320] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:41.973190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:42.036204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06872c7d-a431-4abf-80ee-0f097a4ce3de None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:42.041885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:42.042782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:42.043062 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:42.043318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] PATH_INFO: `/v3/users/2970d465312b495d809629247d1712fd` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:42.044612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2970d465312b495d809629247d1712fd)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:42.046523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:42.093868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2970d465312b495d809629247d1712fd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.104994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2970d465312b495d809629247d1712fd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.111979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2970d465312b495d809629247d1712fd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.115003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2970d465312b495d809629247d1712fd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.124078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2970d465312b495d809629247d1712fd'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.130300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1172/2321] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:41 2022] DELETE /identity/v3/users/2970d465312b495d809629247d1712fd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:42.135231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:42.135807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:42.135807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:42.155640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:42.156919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:42.217927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1150/2322] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:42.228253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:42.229983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:42.296657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c866b47-1abb-4970-ba30-b5872c7f724f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:42.301249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:42.301917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:42.302166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:42.302463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:42.316834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:42.319045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:42.333657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1173/2323] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:42.611563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:42.613131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:42.627873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26710e5b-c621-4ec9-a998-cd72a007d164 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:42.633929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:42.634952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:42.635145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:42.635423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] PATH_INFO: `/v3/projects/6c50825f415e47468c495eaf9c682620` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:42.636770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c50825f415e47468c495eaf9c682620)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:42.638597 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:42.686345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c50825f415e47468c495eaf9c682620', 'request_id': 'req-749a0d80-068d-4e7a-83ae-597f82ad9099'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.691616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c50825f415e47468c495eaf9c682620', 'request_id': 'req-749a0d80-068d-4e7a-83ae-597f82ad9099'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.701136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c50825f415e47468c495eaf9c682620', 'request_id': 'req-749a0d80-068d-4e7a-83ae-597f82ad9099'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.712364 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] The token cache is being invalidate because project 6c50825f415e47468c495eaf9c682620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:42.712644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.713464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.715148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1151/2324] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:42 2022] DELETE /identity/v3/projects/6c50825f415e47468c495eaf9c682620 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:42.719478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:42.729697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ffce8-6e0c-4681-9c2d-787f57d4cab1 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:42.787149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:42.788041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:42.788314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:42.788583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] PATH_INFO: `/v3/users/dc5082f026494284a8c8ae982d42a282` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:42.789804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5082f026494284a8c8ae982d42a282)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:42.792177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:42.845798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5082f026494284a8c8ae982d42a282'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.858760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5082f026494284a8c8ae982d42a282'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.865710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5082f026494284a8c8ae982d42a282'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.866531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5082f026494284a8c8ae982d42a282'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.874332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-959234aa-92b3-46ba-978e-603a43d14c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5082f026494284a8c8ae982d42a282'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:42.880667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1174/2325] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:42 2022] DELETE /identity/v3/users/dc5082f026494284a8c8ae982d42a282 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:43.174440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.175944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:43.189634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0d80-068d-4e7a-83ae-597f82ad9099 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.254871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.255792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.256076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.256332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] PATH_INFO: `/v3/projects/ee5033bafe454094903ea84e7fdbd5e0` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.257554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5033bafe454094903ea84e7fdbd5e0)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.259705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.310768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5033bafe454094903ea84e7fdbd5e0', 'request_id': 'req-018c4691-7241-4c8c-8013-ca91ae3a34e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:43.326467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5033bafe454094903ea84e7fdbd5e0', 'request_id': 'req-018c4691-7241-4c8c-8013-ca91ae3a34e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:43.336145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5033bafe454094903ea84e7fdbd5e0', 'request_id': 'req-018c4691-7241-4c8c-8013-ca91ae3a34e4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:43.347985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] The token cache is being invalidate because project ee5033bafe454094903ea84e7fdbd5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:43.348206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:43.348877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-018c4691-7241-4c8c-8013-ca91ae3a34e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:43.350455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1152/2326] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:43 2022] DELETE /identity/v3/projects/ee5033bafe454094903ea84e7fdbd5e0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:43.355612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.356129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.356223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.373836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:43.375023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:43.435206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1175/2327] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:43.447332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.447646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.447954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.467787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:43.469005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:43.477790 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1153/2328] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:43.482902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.498732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd802c-fea9-46c5-a74a-f638a1eff778 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.507659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.508589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.508915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.509266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.510724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:43.511042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.512730 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.527045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1176/2329] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:43.533500 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.546243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a8f75-42b0-466e-b70e-aaa62a06438b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.552715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.553381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.553664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.553938 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.554620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.557301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.589475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1154/2330] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:43 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:43.593775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.604300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859cc7a-8fc8-4a29-9545-721292e5fa91 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.668356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.669050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.669342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.669625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.670316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.672321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.694454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1177/2331] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:43 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:43.698859 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.709796 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2f7-941d-4c20-ba38-568e83acd2f4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.714825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.715496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.715824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.716105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.716871 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.718493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.728925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1155/2332] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:45:43.732934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.743135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67dc9-3134-4441-a50f-9032f7403d91 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.748342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.749005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.749287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.749564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.750293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.751931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cae54-5d73-4815-809a-0131b5ba3df5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.761980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1178/2333] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:43.766061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.776249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda4d0-c750-4fdc-aaa1-b202e3681252 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:43.781331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:43.782223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.782504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.782780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] PATH_INFO: `/v3/projects/68fd918358ba49d18393d65b0f9e9931/users/ccc6e8485b8c443594b5203000b27633/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.805196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fd918358ba49d18393d65b0f9e9931, user_id=ccc6e8485b8c443594b5203000b27633, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:43.808733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:43.825595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1156/2334] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:43 2022] PUT /identity/v3/projects/68fd918358ba49d18393d65b0f9e9931/users/ccc6e8485b8c443594b5203000b27633/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:43.839795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:43.840133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:43.840420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:43.866875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] MFA Rules not processed for user `ccc6e8485b8c443594b5203000b27633`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:43.868030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:43.929352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1179/2335] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:43.946353 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:43.948511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.016791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e260f-dd86-46c2-8c93-0523370b4d3d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:44.021474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:44.022145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.022427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.022688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.032195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:44.033655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668359-9360-42e5-81d4-a32f18759876 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:44.043073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1157/2336] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:44.062457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:44.132818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52334e-f645-432c-a81e-44f7e11e1c1f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:44.138856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:44.140113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.140398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.140675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] PATH_INFO: `/v3/users/ccc6e8485b8c443594b5203000b27633` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.141910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc6e8485b8c443594b5203000b27633)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:44.143980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:44.202877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc6e8485b8c443594b5203000b27633'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.214208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc6e8485b8c443594b5203000b27633'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.220670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc6e8485b8c443594b5203000b27633'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.221323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc6e8485b8c443594b5203000b27633'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.230674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc6e8485b8c443594b5203000b27633'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.237702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1180/2337] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:44 2022] DELETE /identity/v3/users/ccc6e8485b8c443594b5203000b27633 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:44.243405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.243915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.244048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.283574 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:44.284823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.358065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1158/2338] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:44.368355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:44.369964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.437792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bc784-649f-4847-bf4a-e8667befe3c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:44.441933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:44.442648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.442933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.443234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.453349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:44.454793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671aa992-0762-4124-bc24-bf0b669ad6e3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:44.464448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1181/2339] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:44.757054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:44.758630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.771205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732165e6-63da-4481-b1f9-d4f599dd7057 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:44.776495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:44.777338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.777614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.777877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] PATH_INFO: `/v3/projects/68fd918358ba49d18393d65b0f9e9931` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.779114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fd918358ba49d18393d65b0f9e9931)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:44.781100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:44.833798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fd918358ba49d18393d65b0f9e9931', 'request_id': 'req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.840629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fd918358ba49d18393d65b0f9e9931', 'request_id': 'req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.849580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fd918358ba49d18393d65b0f9e9931', 'request_id': 'req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.860856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] The token cache is being invalidate because project 68fd918358ba49d18393d65b0f9e9931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:44.861138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.861772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e4d63a3c-2ede-48e1-8cb1-99fd6f4a636b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:44.863330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1159/2340] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:44 2022] DELETE /identity/v3/projects/68fd918358ba49d18393d65b0f9e9931 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:44.868386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.868680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.868962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.887402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:44.888609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.958993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1182/2341] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:44.967354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:44.967637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:44.967942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:44.987786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:44.988993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:44.997531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1160/2342] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:45.002331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.013245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ad08-08e3-44ed-8d3f-c80ed8345c04 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.019664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.020403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.020680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.020948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.021673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:45.022010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.023623 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.035726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1183/2343] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:45.042691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.052168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c796e8-a144-47c0-bbd9-3cf814d09320 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.057406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.058071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.058348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.058620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.059391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.061342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.090518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1161/2344] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:45.096057 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.106184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2b25-75bb-4aef-8574-d49fe0b73e21 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.160102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.160823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.161123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.161394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.162155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.164227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.186650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1184/2345] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:45:45.191155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.201690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1103e4-f876-4e6b-a0ef-4b9f0a520844 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.207006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.207704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.207988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.208262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.208989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.210658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.221970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1162/2346] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:45.228224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.243259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3e5d-780c-43df-8141-c3911e2c65a0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.248948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.249635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.249935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.250206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.250949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.252860 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc38ed-8b3e-482a-a081-12bd9c10c2d9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.264444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1185/2347] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:45.269090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.280049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48ae5-0d4f-474b-8865-289b372b50a6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.285419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.286316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.286598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.286870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] PATH_INFO: `/v3/projects/6f7947e1389f46128b4683d662de77c4/users/3c4dd2aa160042bdaf7bbb6bc64c63b4/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.302766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7947e1389f46128b4683d662de77c4, user_id=3c4dd2aa160042bdaf7bbb6bc64c63b4, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.305469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.321605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1163/2348] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:45 2022] PUT /identity/v3/projects/6f7947e1389f46128b4683d662de77c4/users/3c4dd2aa160042bdaf7bbb6bc64c63b4/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:45.332158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.332497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.332776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.360256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] MFA Rules not processed for user `3c4dd2aa160042bdaf7bbb6bc64c63b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:45.361471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:45.435005 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1186/2349] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:45.441027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.516923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f75b86-3015-4527-90f2-836b7b0b5b7f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.522801 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.523471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.523761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.524095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.524783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.526743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.555991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1164/2350] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:45.560447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.572190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba87b3-5452-40dc-b98c-4f0d731a686a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.635280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.636068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.636345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.636618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.637314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.639243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.660857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1187/2351] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:45:45.666699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.677062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f02b2-3f4d-4848-b22e-4c57d9f4fa93 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.681953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.682655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.682967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.683229 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.684012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.685688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.696436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1165/2352] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:45:45.700616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.710894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee6f0-4d42-4e5f-9aa9-cd8ff518dd65 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.716198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.717085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.717368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.717646 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] PATH_INFO: `/v3/projects/20f2ada8862a4289ac989eaddb440f31/users/caab03dbae404956a26c8758e6716f77/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.733211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f2ada8862a4289ac989eaddb440f31, user_id=caab03dbae404956a26c8758e6716f77, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.735932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.755172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1188/2353] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:45 2022] PUT /identity/v3/projects/20f2ada8862a4289ac989eaddb440f31/users/caab03dbae404956a26c8758e6716f77/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:45.760688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.770972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3f97-2bfe-45e8-9c35-55e09e465f7c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.828766 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.829487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.829774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.830052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.830815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.832451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206abeb4-caf6-4e94-b259-c2a5a3abc116 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.843093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1166/2354] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:45.847478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:45.858877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9cc82-3542-4a48-b08a-ea69c93ad7ca admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:45.864922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:45.865822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.866103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.866377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] PATH_INFO: `/v3/projects/20f2ada8862a4289ac989eaddb440f31/users/caab03dbae404956a26c8758e6716f77/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.868686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f2ada8862a4289ac989eaddb440f31, user_id=caab03dbae404956a26c8758e6716f77, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:45.871988 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:45.882698 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1189/2355] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:45 2022] PUT /identity/v3/projects/20f2ada8862a4289ac989eaddb440f31/users/caab03dbae404956a26c8758e6716f77/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:45.900111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:45.900396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:45.900669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:45.930950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] MFA Rules not processed for user `caab03dbae404956a26c8758e6716f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:45.932217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:46.009176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1167/2356] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:46.020512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:46.022569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:46.086774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497d3c-6a86-4c36-b1a2-bb98149e9e5b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:46.093215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:46.093877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:46.094157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:46.094434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:46.160341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:46.161788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaafe2-e0e7-47a4-9e26-4c6e9c94aa51 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:46.174883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1190/2357] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:49.807178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:49.876572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff53b-d52e-4d83-9513-b86e7ca47c87 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:49.881984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:49.882873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:49.883150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:49.883424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] PATH_INFO: `/v3/users/3c4dd2aa160042bdaf7bbb6bc64c63b4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:49.884707 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4dd2aa160042bdaf7bbb6bc64c63b4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:49.886644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:49.939764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4dd2aa160042bdaf7bbb6bc64c63b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:49.951791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4dd2aa160042bdaf7bbb6bc64c63b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:49.952502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4dd2aa160042bdaf7bbb6bc64c63b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:49.953126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4dd2aa160042bdaf7bbb6bc64c63b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:49.962875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4dd2aa160042bdaf7bbb6bc64c63b4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:49.975832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1168/2358] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:49 2022] DELETE /identity/v3/users/3c4dd2aa160042bdaf7bbb6bc64c63b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:49.980504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:49.981032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:49.981032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:49.999346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:50.000628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:50.062732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1191/2359] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:45:50.072851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:50.074309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:50.139001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d83458-ee9f-4b16-b08d-338f7ebb5d0a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:50.144346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:50.145021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:50.145305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:50.145568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:50.156256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:50.157738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:50.167719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1169/2360] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:50.456437 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:50.457984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:50.476639 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a018a-11ef-4a24-9d27-f9d860c8bcdc None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:50.482779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:50.483709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:50.484014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:50.484253 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] PATH_INFO: `/v3/projects/6f7947e1389f46128b4683d662de77c4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:50.485562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7947e1389f46128b4683d662de77c4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:50.487487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:50.539989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7947e1389f46128b4683d662de77c4', 'request_id': 'req-2e04db0b-e6eb-486e-8dcd-5deb06f807df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.548717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7947e1389f46128b4683d662de77c4', 'request_id': 'req-2e04db0b-e6eb-486e-8dcd-5deb06f807df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.560111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7947e1389f46128b4683d662de77c4', 'request_id': 'req-2e04db0b-e6eb-486e-8dcd-5deb06f807df'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.571612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] The token cache is being invalidate because project 6f7947e1389f46128b4683d662de77c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:50.571842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.572496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.574118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1192/2361] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:50 2022] DELETE /identity/v3/projects/6f7947e1389f46128b4683d662de77c4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:50.578419 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:50.588309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0be7-cd0a-4698-b3c0-4fdbb3efea81 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:50.646137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:50.647022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:50.647298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:50.647553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] PATH_INFO: `/v3/users/caab03dbae404956a26c8758e6716f77` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:50.648830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caab03dbae404956a26c8758e6716f77)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:50.650769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:50.701517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caab03dbae404956a26c8758e6716f77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.713921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caab03dbae404956a26c8758e6716f77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.714997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caab03dbae404956a26c8758e6716f77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.716624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caab03dbae404956a26c8758e6716f77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.729892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-93d25cf7-7ef4-44b9-8cea-64ce2be6a254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caab03dbae404956a26c8758e6716f77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:50.743625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1170/2362] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:45:50 2022] DELETE /identity/v3/users/caab03dbae404956a26c8758e6716f77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:51.021490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.023175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:51.036315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04db0b-e6eb-486e-8dcd-5deb06f807df admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.092210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.093119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.093405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.093682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] PATH_INFO: `/v3/projects/20f2ada8862a4289ac989eaddb440f31` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.094933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f2ada8862a4289ac989eaddb440f31)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.096953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.145965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f2ada8862a4289ac989eaddb440f31', 'request_id': 'req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:51.151260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f2ada8862a4289ac989eaddb440f31', 'request_id': 'req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:51.160359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f2ada8862a4289ac989eaddb440f31', 'request_id': 'req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:51.171631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] The token cache is being invalidate because project 20f2ada8862a4289ac989eaddb440f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:51.171939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:51.172590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bf0b3a0f-8f0f-4067-90c2-668c3ae9cc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:51.174164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1193/2363] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:45:51 2022] DELETE /identity/v3/projects/20f2ada8862a4289ac989eaddb440f31 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:51.179493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.180029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.180149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.200218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:51.202285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:51.273194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1171/2364] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:51.282421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.282746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.283065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.318169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:51.319383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:51.327715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1194/2365] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:45:51.334320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.347055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e730c-d4a7-45df-8d08-a205a8c82f7f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.352476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.353148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.353430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.353705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.354438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:51.354745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.356447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.369211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1172/2366] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:51.374661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.384381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48f3b1-6f25-4a04-a6ee-caafaca645a4 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.390719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.391380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.391663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.391982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.392659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.394577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.424715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1195/2367] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:45:51 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:51.428995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.439910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebacf8b-1d9e-424b-9d98-e33341ccc308 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.501576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.502366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.502985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.503328 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.504240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.506352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.530450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1173/2368] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:45:51 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:51.534625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.546619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a91e-ee19-4099-b93e-2d15053c0f97 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.552920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.552920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.552920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.553302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.553794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.555410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.566758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1196/2369] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:45:51.570869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.581231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97112e5-688e-4ccd-bbfa-f03574b93cb7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.586223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.586978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.587257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.587652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.588436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.590058 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efaf0-d8da-40a3-a5be-4afefe8b519e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.602700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1174/2370] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:51.607770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.617624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3df237-6a07-453c-bb39-6747a93c8bd0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.622826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.623759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.624046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.624328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] PATH_INFO: `/v3/projects/f0ea1669a263432ea52548b821f36cb9/users/4d1e5a8fe5cd498d8533d1d9b9ac85a3/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.640678 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ea1669a263432ea52548b821f36cb9, user_id=4d1e5a8fe5cd498d8533d1d9b9ac85a3, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.643419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.660699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1197/2371] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:45:51 2022] PUT /identity/v3/projects/f0ea1669a263432ea52548b821f36cb9/users/4d1e5a8fe5cd498d8533d1d9b9ac85a3/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:51.673615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.673903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.674182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.701246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] MFA Rules not processed for user `4d1e5a8fe5cd498d8533d1d9b9ac85a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:51.702776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:51.768950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1175/2372] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:51.780417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:51.782802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:51.846247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba3eb-5f9d-411c-9d84-579b8bc9e1d2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:51.850663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:51.851324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:51.851608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:51.851911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:51.860630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:51.862023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1acf20-0773-4cf1-b41b-9ee9f5afddb2 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:51.870842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1198/2373] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:57.411762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:57.413695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:57.496865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef98f-253f-4d70-878b-ec047263d94b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:57.503879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:57.504523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:57.504785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:57.505073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:57.507017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:57.525190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:57.527074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:57.542346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1176/2374] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:00.580153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:00.580677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:00.580677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:00.598201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] MFA Rules not processed for user `8d318a968c834567a30e9788e752cdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:00.599490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:00.655002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1199/2375] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:46:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:00.976689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:00.978338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.040786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b7fc-0b7c-4e6b-b68d-032ae550c9e3 service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.046660 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.047630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.048083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.048510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.051074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.066311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.068523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9a5b-5758-46ed-b7e8-8ddf3c9f8606 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.078726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1177/2376] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:46:02.141889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.226364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0d747-a176-4421-9723-e64eeae2546a None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.233145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.234064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.234323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.234595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] PATH_INFO: `/v3/users/4d1e5a8fe5cd498d8533d1d9b9ac85a3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.235928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1e5a8fe5cd498d8533d1d9b9ac85a3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.238640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.300865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1e5a8fe5cd498d8533d1d9b9ac85a3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.312251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1e5a8fe5cd498d8533d1d9b9ac85a3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.319713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1e5a8fe5cd498d8533d1d9b9ac85a3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.320668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1e5a8fe5cd498d8533d1d9b9ac85a3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.331743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1e5a8fe5cd498d8533d1d9b9ac85a3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.338308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1200/2377] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:46:02 2022] DELETE /identity/v3/users/4d1e5a8fe5cd498d8533d1d9b9ac85a3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:02.345851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.346362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.346468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.364751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:02.366019 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:02.427775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1178/2378] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:02.438337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.439770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:02.533174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0026-d7fa-49c9-963d-61ae8cf91b96 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.537337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.538498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.539094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.539659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.551983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.553613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49955f4d-5131-4d61-8e34-636a41767fd4 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.564508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1201/2379] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:46:02.863901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.865340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:02.884312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ee40f-3fe8-4791-9f11-fc379e616449 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.891601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.892621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.892909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.893342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] PATH_INFO: `/v3/projects/f0ea1669a263432ea52548b821f36cb9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.894730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ea1669a263432ea52548b821f36cb9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.896696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.949336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ea1669a263432ea52548b821f36cb9', 'request_id': 'req-ddd3da98-f90f-497b-a0d0-b690057705d3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.954802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ea1669a263432ea52548b821f36cb9', 'request_id': 'req-ddd3da98-f90f-497b-a0d0-b690057705d3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.962466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ea1669a263432ea52548b821f36cb9', 'request_id': 'req-ddd3da98-f90f-497b-a0d0-b690057705d3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.974552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] The token cache is being invalidate because project f0ea1669a263432ea52548b821f36cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:46:02.974821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.975446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:02.977136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1179/2380] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:46:02 2022] DELETE /identity/v3/projects/f0ea1669a263432ea52548b821f36cb9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:45.093616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:45.094146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:45.094259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:45.112272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:45.113477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:45.174158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1202/2381] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:45.222502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:45.224182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:45.298060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3da98-f90f-497b-a0d0-b690057705d3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:45.303425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:45.304116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:45.304395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:45.304672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:45.313147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:45.314916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:45.323262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1180/2382] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:46:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:46:53.503140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:53.504599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:53.606971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80751bb9-7713-4643-97ba-1d81f659eae0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:53.617045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:53.618473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:53.618822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:53.619549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:53.627759 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:53.730222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:53.733741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc6446-3128-4b00-a069-8065a61f0394 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:53.755058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1203/2383] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:47:02.344632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:02.356654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d2e6-495d-4466-a041-bb42ded96426 service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:02.360474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:02.361161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:02.361445 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:02.361717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:02.363622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:02.439158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:02.440683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:02.451015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1181/2384] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:47:04.161969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:04.162472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:04.162706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:04.181330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:47:04.182779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:04.191139 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1204/2385] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:47:04.205011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:04.219074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c287-a7ca-49aa-9e40-60ecdec9407b service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:04.224632 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:04.225788 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:04.226267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:04.226730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:04.238868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:04.241144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:04.251290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1182/2386] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:47:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:47:11.242864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:11.244912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:11.261595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8698-170b-4124-b9f2-22702a011c5d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:11.271612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:11.272793 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:11.273071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:11.273409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] PATH_INFO: `/v3/users/39a6607707914d03886d6c3081cc122e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:11.274724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a6607707914d03886d6c3081cc122e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:11.277612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:11.332006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a6607707914d03886d6c3081cc122e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.344861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a6607707914d03886d6c3081cc122e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.356423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a6607707914d03886d6c3081cc122e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.357176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a6607707914d03886d6c3081cc122e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.365911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a6607707914d03886d6c3081cc122e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.372242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1205/2387] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:47:11 2022] DELETE /identity/v3/users/39a6607707914d03886d6c3081cc122e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:47:11.576531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:11.595157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42e91-8319-4223-bfaf-89591c48fbdc service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:11.656315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:11.657287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:11.657584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:11.657868 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] PATH_INFO: `/v3/projects/323bfd19e97146e39c34d3ba12370590` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:11.659117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=323bfd19e97146e39c34d3ba12370590)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:11.661256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:11.709076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323bfd19e97146e39c34d3ba12370590', 'request_id': 'req-03395ca8-2f65-4eff-8361-5a62f856f2ff'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.714683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323bfd19e97146e39c34d3ba12370590', 'request_id': 'req-03395ca8-2f65-4eff-8361-5a62f856f2ff'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.724965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323bfd19e97146e39c34d3ba12370590', 'request_id': 'req-03395ca8-2f65-4eff-8361-5a62f856f2ff'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.739222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] The token cache is being invalidate because project 323bfd19e97146e39c34d3ba12370590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:47:11.739541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.740243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.741899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1183/2388] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:47:11 2022] DELETE /identity/v3/projects/323bfd19e97146e39c34d3ba12370590 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:47:11.746242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:11.747877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:11.761379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceff10e-23fa-4212-9493-3f1156b403d2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:11.831612 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:11.832536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:11.832993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:11.833429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] PATH_INFO: `/v3/users/63cc093a8f3d46f0987cd51aa79d0496` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:11.835254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cc093a8f3d46f0987cd51aa79d0496)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:11.837403 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:11.911846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cc093a8f3d46f0987cd51aa79d0496'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.926184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cc093a8f3d46f0987cd51aa79d0496'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.933497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cc093a8f3d46f0987cd51aa79d0496'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.934335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cc093a8f3d46f0987cd51aa79d0496'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.945903 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-bce37204-ed4d-46b2-8cb7-0a5072309e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cc093a8f3d46f0987cd51aa79d0496'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:11.956482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1206/2389] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:47:11 2022] DELETE /identity/v3/users/63cc093a8f3d46f0987cd51aa79d0496 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:47:12.156676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:12.158378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:12.180624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395ca8-2f65-4eff-8361-5a62f856f2ff admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:12.257585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:12.258730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:12.259108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:12.259573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] PATH_INFO: `/v3/projects/f779edbfc8e041599692af4aee724c66` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:12.261128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f779edbfc8e041599692af4aee724c66)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:12.263312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:12.340053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f779edbfc8e041599692af4aee724c66', 'request_id': 'req-222fb030-abf0-48bb-8a83-8e76e1144580'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:12.348506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f779edbfc8e041599692af4aee724c66', 'request_id': 'req-222fb030-abf0-48bb-8a83-8e76e1144580'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:12.361336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f779edbfc8e041599692af4aee724c66', 'request_id': 'req-222fb030-abf0-48bb-8a83-8e76e1144580'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:12.375442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] The token cache is being invalidate because project f779edbfc8e041599692af4aee724c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:47:12.375770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:12.376470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:47:12.378615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1184/2390] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:47:12 2022] DELETE /identity/v3/projects/f779edbfc8e041599692af4aee724c66 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:47:22.577818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6c34-1cef-4f42-a69b-1017f39d1da8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:22.578335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6c34-1cef-4f42-a69b-1017f39d1da8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:22.578441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6c34-1cef-4f42-a69b-1017f39d1da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:22.604475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4e3c6c34-1cef-4f42-a69b-1017f39d1da8 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:47:22.605717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4e3c6c34-1cef-4f42-a69b-1017f39d1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:22.679247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1207/2391] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:47:22.691643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:22.693184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:22.765624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb030-abf0-48bb-8a83-8e76e1144580 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:22.770995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:22.771701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:22.772007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:22.772286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:22.782144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:22.783822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:22.793787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1185/2392] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:47:25.671583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:25.672130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:25.672231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:25.691144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] MFA Rules not processed for user `ab522f0209154f959a431caa01f3a029`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:47:25.692379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:25.746201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1208/2393] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:47:28.609103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:28.610703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:28.677220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf62e-9676-4f6a-b830-d255010dc4be service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:28.681184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:28.681845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:28.682120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:28.682390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:28.684784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:28.764399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:28.765861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:28.776719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1186/2394] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:47:31.220894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:47:31.234248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25673c-6913-4121-ad07-b0e270cd2076 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:47:31.238466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:47:31.239111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:47:31.239386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:47:31.239655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:47:31.241563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:47:31.255166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:47:31.256615 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:47:31.267583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1209/2395] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:16.451958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:16.461333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b0dc8-9b84-4bd6-96f1-2525fe959aae service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:16.465079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:16.465730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:16.466014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:16.466292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:16.468257 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:16.535031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:16.536512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:16.547457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1187/2396] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:19.854583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:19.856073 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:19.869962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec586-173d-4b74-9e19-2c3cc8858adb service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:19.874635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:19.875589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:19.875936 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:19.876212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] PATH_INFO: `/v3/users/8d318a968c834567a30e9788e752cdc6` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:19.889992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d318a968c834567a30e9788e752cdc6)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:19.892065 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:19.945208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d318a968c834567a30e9788e752cdc6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:19.957049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d318a968c834567a30e9788e752cdc6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:19.963937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d318a968c834567a30e9788e752cdc6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:19.964628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d318a968c834567a30e9788e752cdc6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:19.973839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d166a7ad-7979-448b-b1ec-91d1e32a227d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d318a968c834567a30e9788e752cdc6'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:19.980172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1210/2397] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:48:19 2022] DELETE /identity/v3/users/8d318a968c834567a30e9788e752cdc6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:20.170948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.182838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a989dbb-d8f4-4a91-83d8-277d4cf6b0b9 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.244922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.245793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.246093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.246387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] PATH_INFO: `/v3/projects/4bfc0cf739ef49329b3abc976a5cf1ab` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.258091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfc0cf739ef49329b3abc976a5cf1ab)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.260080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.312609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfc0cf739ef49329b3abc976a5cf1ab', 'request_id': 'req-06579c44-8413-4af5-9f01-c147df67dd5c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:20.319135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfc0cf739ef49329b3abc976a5cf1ab', 'request_id': 'req-06579c44-8413-4af5-9f01-c147df67dd5c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:20.327890 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfc0cf739ef49329b3abc976a5cf1ab', 'request_id': 'req-06579c44-8413-4af5-9f01-c147df67dd5c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:20.339608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] The token cache is being invalidate because project 4bfc0cf739ef49329b3abc976a5cf1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:20.339930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:20.340568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-06579c44-8413-4af5-9f01-c147df67dd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:20.342129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1188/2398] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:48:20 2022] DELETE /identity/v3/projects/4bfc0cf739ef49329b3abc976a5cf1ab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:20.348770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.349162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.349446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.368497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:20.369738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:20.431789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1211/2399] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:20.440280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.440568 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.440856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.460719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:20.461920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:20.471136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1189/2400] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:20.475449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.493485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fc49a-c805-4084-8c56-01180b2e652e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.501870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.502573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.502856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.503198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.503989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:48:20.504303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.505944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.518147 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1212/2401] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:48:20.523088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.532949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83737c-12ab-420e-a223-5108b5225016 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.539412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.540114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.540394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.540659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.541655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.543621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.576488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1190/2402] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:20 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:20.581381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.591710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401c5d-b207-442b-a6c4-55269bb28fc1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.655934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.656622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.656901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.657203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.658271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.660081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.680926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1213/2403] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:20 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:20.685444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.696477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7a6c8-0340-4088-9748-2282415f34a4 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.702452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.703184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.703626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.703940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.705037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.706509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.718424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1191/2404] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:20.722608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.733308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5dc80-a680-4aab-a1ca-4b6d9fba344f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.740458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.741175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.741462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.741738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.742503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.744226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e8b6-659e-4594-8120-a82d340d78ad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.755338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1214/2405] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:48:20.759672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.776687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a78c-89b1-4861-92bf-14dc076b173e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:20.781802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:20.782828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.783251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.783539 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] PATH_INFO: `/v3/projects/024250b3c3f44403aa1ee20f63b1ed90/users/a59d9dff3aa142a481bb8b69c40228bf/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.799728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024250b3c3f44403aa1ee20f63b1ed90, user_id=a59d9dff3aa142a481bb8b69c40228bf, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:20.802425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:20.816424 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1192/2406] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:20 2022] PUT /identity/v3/projects/024250b3c3f44403aa1ee20f63b1ed90/users/a59d9dff3aa142a481bb8b69c40228bf/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:20.829675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:20.830105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:20.830446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:20.861617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] MFA Rules not processed for user `a59d9dff3aa142a481bb8b69c40228bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:20.862817 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:20.933688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1215/2407] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:20.945340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:20.947467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:21.035357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b4a1e-caab-418b-81fb-4d7612d5f5b3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:21.043263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:21.044025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:21.044306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:21.044579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:21.053684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:21.055279 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdcf52-639b-4706-a958-2ea23da78d02 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:21.064935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1193/2408] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:29.447043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:29.515620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7753cb-0479-459e-ab02-930b610fcbce None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:29.522461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:29.523353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:29.523634 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:29.523955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] PATH_INFO: `/v3/users/a59d9dff3aa142a481bb8b69c40228bf` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:29.525301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59d9dff3aa142a481bb8b69c40228bf)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:29.527252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:29.587846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59d9dff3aa142a481bb8b69c40228bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:29.602166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59d9dff3aa142a481bb8b69c40228bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:29.612265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59d9dff3aa142a481bb8b69c40228bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:29.613039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59d9dff3aa142a481bb8b69c40228bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:29.623397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59d9dff3aa142a481bb8b69c40228bf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:29.629596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1216/2409] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:48:29 2022] DELETE /identity/v3/users/a59d9dff3aa142a481bb8b69c40228bf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:48:29.634337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:29.634813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:29.634919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:29.652335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:29.653521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:29.717056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1194/2410] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:29.727409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:29.728991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:29.788957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f44f8-ef2d-4549-bde9-1d7ebc28fdac admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:29.793619 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:29.794302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:29.794583 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:29.794859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:29.804999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:29.806471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa989cbf-c2eb-47f8-8da0-6cb7a1fda0a8 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:29.816925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1217/2411] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:30.090674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.092268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:30.107579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da910f-b930-4b3f-9196-2a8bde945652 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.113234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.114169 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.114375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.114641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] PATH_INFO: `/v3/projects/024250b3c3f44403aa1ee20f63b1ed90` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.115963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024250b3c3f44403aa1ee20f63b1ed90)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.118030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.164755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024250b3c3f44403aa1ee20f63b1ed90', 'request_id': 'req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:30.170192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024250b3c3f44403aa1ee20f63b1ed90', 'request_id': 'req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:30.178717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024250b3c3f44403aa1ee20f63b1ed90', 'request_id': 'req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:30.189544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] The token cache is being invalidate because project 024250b3c3f44403aa1ee20f63b1ed90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:30.189831 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:30.190467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-ab9747f4-4e19-4eb5-8b09-d8dbe4386ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:30.192201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1195/2412] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:48:30 2022] DELETE /identity/v3/projects/024250b3c3f44403aa1ee20f63b1ed90 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:30.197418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.197714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.197993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.216447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:30.217762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:30.284572 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1218/2413] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:30.294218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.294507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.294786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.314562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:30.315764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:30.325756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1196/2414] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:30.330381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.340895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a99e9-906e-41a4-8f51-edc987771829 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.346790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.347457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.347737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.348041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.348750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:48:30.349056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.350665 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.362934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1219/2415] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:48:30.368832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.383073 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b291-3e79-4ff5-8e95-6d6daebd5af9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.392626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.393579 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.393954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.394314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.395004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.396939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.428024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1197/2416] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:30.432352 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.446334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be039dcf-f3c5-4c2a-ad1f-332e0f3bcde8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.512192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.512844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.513146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.513425 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.514117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.516089 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.538537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1220/2417] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:30.543074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.553843 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e1c5-e88f-42cd-9333-072b234bf04b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.559596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.560325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.560608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.560887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.561622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.563298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.590302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1198/2418] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:48:30.594687 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.607322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a6ae-59cf-48b2-bd43-2f1b1c30d65f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.614284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.615091 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.615378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.615648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.616405 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.618061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be93d-a0c4-405e-9979-dde71e1bdfba admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.628964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1221/2419] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:30.635970 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.652485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34001b8f-18dc-4109-b4e3-6c7c51afbca0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.661074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.662003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.662278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.662547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] PATH_INFO: `/v3/projects/eaca5bd74c514902a45da109a0d7df96/users/cf03e74dc4cf4f53b0af2ff45b9cd72d/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.678762 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaca5bd74c514902a45da109a0d7df96, user_id=cf03e74dc4cf4f53b0af2ff45b9cd72d, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.681374 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.696246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1199/2420] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:30 2022] PUT /identity/v3/projects/eaca5bd74c514902a45da109a0d7df96/users/cf03e74dc4cf4f53b0af2ff45b9cd72d/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:30.710816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.711102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.711359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.738004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] MFA Rules not processed for user `cf03e74dc4cf4f53b0af2ff45b9cd72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:30.739187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:30.800989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1222/2421] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:30.805697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.880599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389aaa5-4fcb-43ff-bc27-56df92d88183 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.886436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.887144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.887405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.887720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.888442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.890373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:30.921047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1200/2422] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:30.925248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:30.936217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cf829-3f9b-4254-932e-2994c9186236 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:30.993564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:30.994238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:30.994519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:30.994792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:30.995490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:30.997467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.023508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1223/2423] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:30 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:31.027669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.039881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4883bb-0a3f-4a0c-9068-cd61eb95b0ea admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.048126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.049094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.049458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.049829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.051072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.053025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.063576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1201/2424] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:31.068028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.078711 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8da8d1-d27e-4dd0-811d-b601ca1607d6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.084476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.085370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.085650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.085923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] PATH_INFO: `/v3/projects/773f82e7dfbc4765b77f4530e045ccdc/users/fa0178b09ba044dbb276ae2468abf37a/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.101185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=773f82e7dfbc4765b77f4530e045ccdc, user_id=fa0178b09ba044dbb276ae2468abf37a, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.103922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.114111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.116186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:31.119642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1224/2425] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:31 2022] PUT /identity/v3/projects/773f82e7dfbc4765b77f4530e045ccdc/users/fa0178b09ba044dbb276ae2468abf37a/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:31.123871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.176531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5d00-b9cd-444b-8e73-4291861de6c3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.187300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfab78-7123-47ee-bbb1-903746acb80a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.192134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.192809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.193086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.193360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.194125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.195746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.206275 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1225/2426] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:48:31.209927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.219111 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a82a28-0cdf-46ad-a609-11ce9f109291 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.223948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.224152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.224809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.224925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.225088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.225187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.225359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.225473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] PATH_INFO: `/v3/projects/773f82e7dfbc4765b77f4530e045ccdc/users/fa0178b09ba044dbb276ae2468abf37a/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.227234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:31.227454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773f82e7dfbc4765b77f4530e045ccdc, user_id=fa0178b09ba044dbb276ae2468abf37a, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.230090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2dde7-2037-4927-9356-d22b778334e3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.240157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1226/2427] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:31 2022] PUT /identity/v3/projects/773f82e7dfbc4765b77f4530e045ccdc/users/fa0178b09ba044dbb276ae2468abf37a/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:48:31.250248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.250546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.250832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.277636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] MFA Rules not processed for user `fa0178b09ba044dbb276ae2468abf37a`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:31.278925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:31.304948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.306397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.325187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1202/2428] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:48:31.348622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1227/2429] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:48:31.360001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.361453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:31.372082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cedd14-ea38-496a-ac6d-9334869b9472 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.420998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.421661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.421936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.422304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.431617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.433067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.442700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1203/2430] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:31.518570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:31.529166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958875-db6e-41d1-aa2c-58b82fb706f3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:31.532948 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:31.533592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:31.533865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:31.534137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:31.597784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:31.599824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:31.609191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1228/2431] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:38.650891 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:38.652637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:38.719308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6bf44-06f5-4e0d-8aab-daf501b49873 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:38.724050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:38.724771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:38.725213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:38.725504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:38.727731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:38.744902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:38.746314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:38.756958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1204/2432] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:42.910212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:42.920240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c25a24-9928-4114-9173-5f457e28569c service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:42.923877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:42.924517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:42.924796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:42.925070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:42.926917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:42.995035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:42.996607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:43.006749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1229/2433] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:46.323644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.325156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:46.340196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5337f63-3dc0-4b6b-b586-02ead531d8d9 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.345159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.346070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.346346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.346602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] PATH_INFO: `/v3/users/f7b41d1655e24cf0b1f4bda137115af4` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.347870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b41d1655e24cf0b1f4bda137115af4)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.349802 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.400282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b41d1655e24cf0b1f4bda137115af4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.412870 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b41d1655e24cf0b1f4bda137115af4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.413650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b41d1655e24cf0b1f4bda137115af4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.414282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b41d1655e24cf0b1f4bda137115af4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.423962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-607e001a-a7d2-4574-be0f-83131e838ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b41d1655e24cf0b1f4bda137115af4'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.437300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1205/2434] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:48:46 2022] DELETE /identity/v3/users/f7b41d1655e24cf0b1f4bda137115af4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:48:46.617160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.627417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc28b8-297a-4d43-b8dd-1b680cd4c53d service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.686893 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.687997 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.688530 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.688743 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] PATH_INFO: `/v3/projects/0dd7bf482a7c472bbe4857f2d71d00e1` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.690211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd7bf482a7c472bbe4857f2d71d00e1)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.692454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.747449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd7bf482a7c472bbe4857f2d71d00e1', 'request_id': 'req-09c95d09-0ce5-4f71-830c-83c8891a3d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.754971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd7bf482a7c472bbe4857f2d71d00e1', 'request_id': 'req-09c95d09-0ce5-4f71-830c-83c8891a3d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.763125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd7bf482a7c472bbe4857f2d71d00e1', 'request_id': 'req-09c95d09-0ce5-4f71-830c-83c8891a3d5d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.775616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] The token cache is being invalidate because project 0dd7bf482a7c472bbe4857f2d71d00e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:46.775984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.776679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-09c95d09-0ce5-4f71-830c-83c8891a3d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:46.778784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1230/2435] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:48:46 2022] DELETE /identity/v3/projects/0dd7bf482a7c472bbe4857f2d71d00e1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:46.784787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.787997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.788451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.816238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:46.817536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:46.884056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1206/2436] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:46.891567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.892004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.892346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.917343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:46.918630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:46.928034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1231/2437] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:46.932596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.942339 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0b1f-6670-4fb2-81f5-0bac6836cd5c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.947142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.947853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.948133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.948403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.949158 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:48:46.949458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.951060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.962387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1207/2438] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:48:46.966786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.976287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cab8d-98b8-4e28-b562-b3cc46fc3b52 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.982095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.982792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.983076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.983345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.984066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.985964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.016107 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1232/2439] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:46 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:47.021956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:47.032652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d95cb-4298-45c6-ba60-f99cabfefaaf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:47.091551 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:47.092277 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.092556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.092836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.093505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:47.095432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.116357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1208/2440] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:47 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:47.120892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:47.133521 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaa609-35fd-412a-af56-f431180e4eaa admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:47.139095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:47.139822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.140106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.140379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.141112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:47.142726 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.154202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1233/2441] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:47.159004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:47.170754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d9603-3534-4a19-a723-20860eaeffbe admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:47.177002 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:47.177713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.177996 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.178249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.179033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:47.180745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13391c1-e46d-4791-99ab-02bbfd2b1c17 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.191940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1209/2442] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:47.196260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:47.206648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a9f8-05d8-4221-97c7-6abacbf165a6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:47.212034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:47.212927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.213203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.213473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] PATH_INFO: `/v3/projects/433f02685b2147f388e5a6f8f3d50c08/users/c1c2c2e35dfb4b87a42448e7dce66d35/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.228350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433f02685b2147f388e5a6f8f3d50c08, user_id=c1c2c2e35dfb4b87a42448e7dce66d35, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:47.230990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.245040 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1234/2443] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:47 2022] PUT /identity/v3/projects/433f02685b2147f388e5a6f8f3d50c08/users/c1c2c2e35dfb4b87a42448e7dce66d35/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:47.250094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffd768-92ff-4520-a97a-2f7016e25dd3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.250406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffd768-92ff-4520-a97a-2f7016e25dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.250690 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffd768-92ff-4520-a97a-2f7016e25dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.268875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-03ffd768-92ff-4520-a97a-2f7016e25dd3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:47.270081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-03ffd768-92ff-4520-a97a-2f7016e25dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:47.333913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1210/2444] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:48:47.344593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:47.346432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:47.407961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74aaf-f5e5-4a28-80ca-7d4a67bedc03 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:47.412526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:47.413217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:47.413502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:47.413786 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:47.425902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:47.428104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:47.437901 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1235/2445] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:48.059463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.059784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.060358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.089387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] MFA Rules not processed for user `c1c2c2e35dfb4b87a42448e7dce66d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:48.091042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:48.164712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1211/2446] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:48.169546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.179881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f10b8-b1e9-4f3a-bd89-bd097de402b6 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.184650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.185533 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.185928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.186387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.187200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.189445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.224771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.233183 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1236/2447] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:48 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:48.245408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177eea-6781-489f-ba66-dc542e4d7680 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.306376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.307472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.307862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.308272 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.309211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.311456 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.335735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1212/2448] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:48 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:48.339502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.349699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66d71-1da7-49e6-8413-de838c73b934 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.354323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.354985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.355264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.355537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.356303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.357895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.368168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1237/2449] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:48.372371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.382153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20550c3-7dca-47b7-9baa-efca623cc8f6 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.386814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.387729 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.388014 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.388288 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] PATH_INFO: `/v3/projects/11563c50b8904048bb8f5e8882f9edec/users/fdc111fcdbbe440e858c272e57f1f442/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.403719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11563c50b8904048bb8f5e8882f9edec, user_id=fdc111fcdbbe440e858c272e57f1f442, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.406378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.423038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1213/2450] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:48 2022] PUT /identity/v3/projects/11563c50b8904048bb8f5e8882f9edec/users/fdc111fcdbbe440e858c272e57f1f442/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:48.429609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.439945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ce88-0153-40a2-ad3b-eda7fa235b20 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.502023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.502815 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.503098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.503366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.504122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.505708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4e569-e143-4d09-92bb-0514d17ac2d1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.517105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1238/2451] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:48.522799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:48.533072 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa8fd-f28d-4c0b-9085-0de6683df65c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:48.537936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:48.538822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:48.539098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:48.539368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] PATH_INFO: `/v3/projects/11563c50b8904048bb8f5e8882f9edec/users/fdc111fcdbbe440e858c272e57f1f442/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:48.541679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11563c50b8904048bb8f5e8882f9edec, user_id=fdc111fcdbbe440e858c272e57f1f442, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:48.544386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:48.554289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1214/2452] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:48 2022] PUT /identity/v3/projects/11563c50b8904048bb8f5e8882f9edec/users/fdc111fcdbbe440e858c272e57f1f442/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:49.166025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:49.166644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:49.166924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:49.195113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] MFA Rules not processed for user `fdc111fcdbbe440e858c272e57f1f442`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:49.196296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:49.268059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1239/2453] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:50.319921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:50.383979 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0aebe-89c2-420d-9989-cf6dd768d88b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:50.389437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:50.390316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:50.390598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:50.390877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] PATH_INFO: `/v3/users/c1c2c2e35dfb4b87a42448e7dce66d35` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:50.392211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c2c2e35dfb4b87a42448e7dce66d35)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:50.394183 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:50.443587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c2c2e35dfb4b87a42448e7dce66d35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.455517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c2c2e35dfb4b87a42448e7dce66d35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.456326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c2c2e35dfb4b87a42448e7dce66d35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.457098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c2c2e35dfb4b87a42448e7dce66d35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.467102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c2c2e35dfb4b87a42448e7dce66d35'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.479235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1215/2454] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:48:50 2022] DELETE /identity/v3/users/c1c2c2e35dfb4b87a42448e7dce66d35 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:50.660588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:50.672144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978c0c0-2045-432e-9992-07bc49727c17 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:50.731475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:50.732402 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:50.732684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:50.732959 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] PATH_INFO: `/v3/projects/433f02685b2147f388e5a6f8f3d50c08` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:50.734174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433f02685b2147f388e5a6f8f3d50c08)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:50.736175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:50.783574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433f02685b2147f388e5a6f8f3d50c08', 'request_id': 'req-d91b7337-7e53-498f-8824-a46fb182f9f8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.788904 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433f02685b2147f388e5a6f8f3d50c08', 'request_id': 'req-d91b7337-7e53-498f-8824-a46fb182f9f8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.798166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433f02685b2147f388e5a6f8f3d50c08', 'request_id': 'req-d91b7337-7e53-498f-8824-a46fb182f9f8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.808649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] The token cache is being invalidate because project 433f02685b2147f388e5a6f8f3d50c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:50.808939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.810023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.811557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1240/2455] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:48:50 2022] DELETE /identity/v3/projects/433f02685b2147f388e5a6f8f3d50c08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:50.815738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:50.817165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:50.830615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdd87-0f1b-4201-aa33-4b2a82f242cf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:50.889975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:50.890919 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:50.891186 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:50.891491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] PATH_INFO: `/v3/users/fdc111fcdbbe440e858c272e57f1f442` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:50.892779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc111fcdbbe440e858c272e57f1f442)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:50.894775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:50.945567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc111fcdbbe440e858c272e57f1f442'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.970233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc111fcdbbe440e858c272e57f1f442'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.971227 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc111fcdbbe440e858c272e57f1f442'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.972127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc111fcdbbe440e858c272e57f1f442'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:50.986220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-73591750-54fd-41eb-9135-5f7bf46595e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc111fcdbbe440e858c272e57f1f442'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.000006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1216/2456] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:48:50 2022] DELETE /identity/v3/users/fdc111fcdbbe440e858c272e57f1f442 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:51.182041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.183555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:51.196357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b7337-7e53-498f-8824-a46fb182f9f8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.255360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.256268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.256547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.256852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] PATH_INFO: `/v3/projects/11563c50b8904048bb8f5e8882f9edec` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.258100 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11563c50b8904048bb8f5e8882f9edec)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.260082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.310267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11563c50b8904048bb8f5e8882f9edec', 'request_id': 'req-9521b001-b1b8-497f-9d1e-44bc979c0e4e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.315462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11563c50b8904048bb8f5e8882f9edec', 'request_id': 'req-9521b001-b1b8-497f-9d1e-44bc979c0e4e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.324124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11563c50b8904048bb8f5e8882f9edec', 'request_id': 'req-9521b001-b1b8-497f-9d1e-44bc979c0e4e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.335209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] The token cache is being invalidate because project 11563c50b8904048bb8f5e8882f9edec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:51.335567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.336248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9521b001-b1b8-497f-9d1e-44bc979c0e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:51.337782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1241/2457] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:48:51 2022] DELETE /identity/v3/projects/11563c50b8904048bb8f5e8882f9edec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:51.342921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.343404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.343518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.363712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:51.364955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:51.431179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1217/2458] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:51.440328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.440616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.440888 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.460341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:51.461820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:51.471017 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1242/2459] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:51.475457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.486123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488e5d-4293-43e1-88cd-f6dc42db67b6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.491865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.492526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.492986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.493293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.494023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:48:51.494326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.495982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.508330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1218/2460] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:48:51.512609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.522050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e21ab-5749-4898-bd96-dab46be117e6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.528152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.529085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.529371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.529669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.530372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.532328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.563260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1243/2461] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:51.567413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.577685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b66af-a748-47c0-85f1-7448d2f14cd1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.638878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.639609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.639929 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.640177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.640865 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.642771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.665778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1219/2462] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:51.670109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.680733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64e74a-bd87-4cbc-83fc-6d9a3eede621 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.685764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.686419 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.686699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.686967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.687752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.689336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.702251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1244/2463] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:48:51.706550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.719782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0612b7-1fb5-4331-a3ed-4bcb64cf25e8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.725565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.726428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.726776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.727151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.728401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.730430 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2854ad3-f5a9-4e01-9cb0-7d10880e468f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.744668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1220/2464] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:51.745978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.756938 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7870fc-cfe7-47a2-808a-5531e9e8a411 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.762237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.763128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.763407 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.763677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] PATH_INFO: `/v3/projects/84509b11889840e098fffbd4bb539ec1/users/5ff524e6ffda4c738a9a22bd7a6e1c61/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.778928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84509b11889840e098fffbd4bb539ec1, user_id=5ff524e6ffda4c738a9a22bd7a6e1c61, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.781777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:51.796197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1245/2465] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:51 2022] PUT /identity/v3/projects/84509b11889840e098fffbd4bb539ec1/users/5ff524e6ffda4c738a9a22bd7a6e1c61/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:51.806533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.806819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.807093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.838165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] MFA Rules not processed for user `5ff524e6ffda4c738a9a22bd7a6e1c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:51.838165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:51.902453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1221/2466] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:51.907054 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:51.969752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93b97-84da-433e-8658-a996d0814c09 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:51.976166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:51.976842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:51.977124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:51.977399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:51.978104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:51.980140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.009994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1246/2467] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:51 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:52.014443 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.026063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe33e1-7fe7-49dc-b99f-e8a5878d9b5b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.087811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.088526 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.088787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.089063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.089783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.092064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.117483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1222/2468] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:52 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:52.122955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.133712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0295f0-5413-4b59-b6c9-9cf293c0d5f7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.138753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.139417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.139731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.140012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.140742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.142345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.153393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1247/2469] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:52.157397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.168517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41c12-47e1-4049-a162-b6152eeff2ed admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.173980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.174647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.174925 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.175193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.175957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.177546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff7b07-de2a-4416-959d-596312cb14fd admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.187672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1223/2470] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:52.191894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.202500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484799-6d46-4d34-bed7-4957dc0a8686 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.208499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.209424 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.209742 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.210045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] PATH_INFO: `/v3/projects/ca8d99ce21f74e3196c9dfc03479925a/users/40e6afe389c54d11a2cdeb4adac53f91/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.225971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8d99ce21f74e3196c9dfc03479925a, user_id=40e6afe389c54d11a2cdeb4adac53f91, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.228696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.245030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1248/2471] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:52 2022] PUT /identity/v3/projects/ca8d99ce21f74e3196c9dfc03479925a/users/40e6afe389c54d11a2cdeb4adac53f91/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:48:52.255446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.255767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.256055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.292511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] MFA Rules not processed for user `40e6afe389c54d11a2cdeb4adac53f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:52.293774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:52.360319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1224/2472] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:52.364650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.426832 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c018ca-d840-4712-bbd8-7e5018f53178 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.431894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.432561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.432840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.433112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.433809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.435739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.462156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1249/2473] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:48:52 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:48:52.466214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.476901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f831c0f-ff5e-42f6-821a-b287b91e48cb None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.535863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.536548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.536824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.537117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.537800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.539910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.560475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1225/2474] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:48:52 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:52.564551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.574715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca8e9-837e-4630-b562-f27291471d39 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.580568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.581235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.581509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.581776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.582498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.584158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.595628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1250/2475] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:52.600067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.610770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec5c1-a3f6-4eea-8001-cb466b40783e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.616999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.617915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.618191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.618462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] PATH_INFO: `/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c/users/42b2d40d80af42d2b20f7b3a379043eb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.633821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd887d2da7b4d1d8cf38655dcfacd8c, user_id=42b2d40d80af42d2b20f7b3a379043eb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.636533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.650256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1226/2476] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:52 2022] PUT /identity/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c/users/42b2d40d80af42d2b20f7b3a379043eb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:52.654510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.665667 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abc0a-a926-4c5e-b12f-22c157ff2c63 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.724879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.726066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.726066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.726298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.727018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.728625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd64b1-fb3e-420f-a96d-3ca2313511d8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.738233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1251/2477] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:52.742780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.753360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81822-f84f-432d-99ba-3bfbb2bdc582 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.758237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.759135 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.759415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.759676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] PATH_INFO: `/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c/users/42b2d40d80af42d2b20f7b3a379043eb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.761764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd887d2da7b4d1d8cf38655dcfacd8c, user_id=42b2d40d80af42d2b20f7b3a379043eb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.764451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:52.775798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1227/2478] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:48:52 2022] PUT /identity/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c/users/42b2d40d80af42d2b20f7b3a379043eb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:52.786421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.786703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.787067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.813818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] MFA Rules not processed for user `42b2d40d80af42d2b20f7b3a379043eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:52.815047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:52.886839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1252/2479] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:52.898732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:52.900451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:52.969509 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1c7a-155d-42f2-aee7-d33906e1ca2b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:52.974297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:52.975245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:52.975606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:52.975959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:52.992042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:52.993484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:53.003216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1228/2480] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:53.581650 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:53.583291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:53.596307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d8d3-a15e-44cf-8075-5899850b7a9b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:53.600940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:53.601580 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:53.601861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:53.602138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:53.659481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:53.660939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:53.670892 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1253/2481] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:04.089074 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:04.098118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca568-db83-4fb2-9bf4-bf0d04711e3f service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:04.102629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:04.103469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:04.103743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:04.104037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:04.168773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:04.171200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5c27a-c2e7-4a16-8fcb-e3438adf266b service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:04.186140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1229/2482] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:06.391927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:06.455268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957147a2-ded3-428a-b400-8058360e784b service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:06.459971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:06.460850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:06.461130 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:06.461401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] PATH_INFO: `/v3/users/5ff524e6ffda4c738a9a22bd7a6e1c61` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:06.463050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff524e6ffda4c738a9a22bd7a6e1c61)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:06.465518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:06.522896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff524e6ffda4c738a9a22bd7a6e1c61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:06.534855 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff524e6ffda4c738a9a22bd7a6e1c61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:06.542524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff524e6ffda4c738a9a22bd7a6e1c61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:06.543243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff524e6ffda4c738a9a22bd7a6e1c61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:06.551523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff524e6ffda4c738a9a22bd7a6e1c61'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:06.558899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1254/2483] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:06 2022] DELETE /identity/v3/users/5ff524e6ffda4c738a9a22bd7a6e1c61 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:06.563640 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:06.564176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:06.564176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:06.581095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:06.582273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:06.645676 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1230/2484] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:06.656330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:06.658047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:06.716924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ea15-c69b-4980-95bf-a49263addbc7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:06.721354 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:06.722036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:06.722316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:06.722589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:06.732768 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:06.734227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:06.744382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1255/2485] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:07.035617 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:07.037331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:07.049933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfe7e-a324-4845-8506-7d4564165510 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:07.055271 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:07.056189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:07.056572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:07.056877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] PATH_INFO: `/v3/projects/84509b11889840e098fffbd4bb539ec1` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:07.058147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84509b11889840e098fffbd4bb539ec1)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:07.060134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:07.109420 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84509b11889840e098fffbd4bb539ec1', 'request_id': 'req-f4de168b-41f3-46a2-b21d-285560d86f98'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.114928 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84509b11889840e098fffbd4bb539ec1', 'request_id': 'req-f4de168b-41f3-46a2-b21d-285560d86f98'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.123235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84509b11889840e098fffbd4bb539ec1', 'request_id': 'req-f4de168b-41f3-46a2-b21d-285560d86f98'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.134460 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] The token cache is being invalidate because project 84509b11889840e098fffbd4bb539ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:07.134781 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.135425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.137128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1231/2486] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:07 2022] DELETE /identity/v3/projects/84509b11889840e098fffbd4bb539ec1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:07.141156 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:07.151097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90489-aad6-4f5e-9484-bbc19072df05 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:07.216849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:07.218389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:07.218896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:07.219396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] PATH_INFO: `/v3/users/40e6afe389c54d11a2cdeb4adac53f91` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:07.221760 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e6afe389c54d11a2cdeb4adac53f91)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:07.224696 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:07.273524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e6afe389c54d11a2cdeb4adac53f91'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.285148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e6afe389c54d11a2cdeb4adac53f91'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.292457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e6afe389c54d11a2cdeb4adac53f91'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.293174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e6afe389c54d11a2cdeb4adac53f91'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.301980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e6afe389c54d11a2cdeb4adac53f91'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.308384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1256/2487] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:07 2022] DELETE /identity/v3/users/40e6afe389c54d11a2cdeb4adac53f91 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:07.588005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:07.589463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:07.602209 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de168b-41f3-46a2-b21d-285560d86f98 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:07.659283 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:07.660231 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:07.660513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:07.660971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] PATH_INFO: `/v3/projects/ca8d99ce21f74e3196c9dfc03479925a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:07.662222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8d99ce21f74e3196c9dfc03479925a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:07.664244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:07.715493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8d99ce21f74e3196c9dfc03479925a', 'request_id': 'req-7b06f340-8199-49fa-b5fa-04595b620303'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.721237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8d99ce21f74e3196c9dfc03479925a', 'request_id': 'req-7b06f340-8199-49fa-b5fa-04595b620303'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.730409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8d99ce21f74e3196c9dfc03479925a', 'request_id': 'req-7b06f340-8199-49fa-b5fa-04595b620303'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.742589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] The token cache is being invalidate because project ca8d99ce21f74e3196c9dfc03479925a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:07.742982 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.743524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.745531 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1232/2488] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:07 2022] DELETE /identity/v3/projects/ca8d99ce21f74e3196c9dfc03479925a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:07.749957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:07.751375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:07.765643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b029f-da31-4dc3-9a6c-58c2350d5c46 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:07.827608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:07.828644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:07.829003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:07.829288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] PATH_INFO: `/v3/users/42b2d40d80af42d2b20f7b3a379043eb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:07.830666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b2d40d80af42d2b20f7b3a379043eb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:07.832831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:07.892648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b2d40d80af42d2b20f7b3a379043eb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.906882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b2d40d80af42d2b20f7b3a379043eb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.914825 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b2d40d80af42d2b20f7b3a379043eb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.915916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b2d40d80af42d2b20f7b3a379043eb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.924810 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-fa7e3bd0-8893-4fbf-9455-a41c3eb01ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b2d40d80af42d2b20f7b3a379043eb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:07.931142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1257/2489] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:07 2022] DELETE /identity/v3/users/42b2d40d80af42d2b20f7b3a379043eb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:08.237007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.238646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:08.252727 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f340-8199-49fa-b5fa-04595b620303 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.316310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.317137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.317416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.317688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] PATH_INFO: `/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.318876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd887d2da7b4d1d8cf38655dcfacd8c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.320858 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.367431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd887d2da7b4d1d8cf38655dcfacd8c', 'request_id': 'req-cc1b1bb6-ea08-4711-94ef-312b43f16a65'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:08.372763 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd887d2da7b4d1d8cf38655dcfacd8c', 'request_id': 'req-cc1b1bb6-ea08-4711-94ef-312b43f16a65'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:08.381817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd887d2da7b4d1d8cf38655dcfacd8c', 'request_id': 'req-cc1b1bb6-ea08-4711-94ef-312b43f16a65'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:08.392860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] The token cache is being invalidate because project 5cd887d2da7b4d1d8cf38655dcfacd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:08.393140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:08.393799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cc1b1bb6-ea08-4711-94ef-312b43f16a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:08.395357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1233/2490] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:08 2022] DELETE /identity/v3/projects/5cd887d2da7b4d1d8cf38655dcfacd8c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:08.402247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.402624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.402913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.421871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:08.423052 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:08.480466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1258/2491] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:08.488408 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.488696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.489001 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.510440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:08.511659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:08.521247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1234/2492] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:08.525924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.535704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4377b-b57b-481e-9955-56fa2b8be59d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.540712 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.542573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.542849 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.543122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.543861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:08.544168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.545761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.557608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1259/2493] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:08.564955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.577179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd3d2d-13e2-4fdb-ba26-6a57d0112126 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.582764 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.583428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.583739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.584018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.584703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.586608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.616063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1235/2494] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:08.621153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.631231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24701-e802-44de-b70f-2a574c364a43 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.693705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.694635 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.694951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.695322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.696411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.698870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.720848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1260/2495] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:08.725314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.737394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd489-5662-445f-836a-1927eb1858a8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.745152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.746113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.746485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.746851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.748033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.750515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.765081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1236/2496] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:08.769297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.779812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a58be-c8c7-43de-83de-1361ab091569 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.784882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.785543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.785822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.786094 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.786823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.788482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda067f-ebc4-4d1c-aec6-91cbf999d0fa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.799112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1261/2497] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:08.803200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:08.813797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae73f6-fa12-4488-b92b-cef67ba094f1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:08.819207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:08.820142 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.820425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.820699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] PATH_INFO: `/v3/projects/2a9db419b3344bc19c6e6ddbe65c3b79/users/d450604f880549dcbd01ef7e57fe58d3/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.836922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9db419b3344bc19c6e6ddbe65c3b79, user_id=d450604f880549dcbd01ef7e57fe58d3, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:08.839590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:08.855673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1237/2498] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:08 2022] PUT /identity/v3/projects/2a9db419b3344bc19c6e6ddbe65c3b79/users/d450604f880549dcbd01ef7e57fe58d3/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:08.868699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:08.869075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:08.869493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:08.904450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] MFA Rules not processed for user `d450604f880549dcbd01ef7e57fe58d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:08.905693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:08.971700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1262/2499] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:08.976088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.037913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76931b-0707-429f-ad29-da75d68d6061 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.043522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.044098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.044381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.044661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.045368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.047573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.079065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1238/2500] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:08 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:09.080379 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.091867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54af80-a52b-4a9b-bb6c-f03d62178eeb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.150785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.151620 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.151944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.152220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.152907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.154934 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.178146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1263/2501] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:09 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:09.182613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.193262 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2bd6-5195-4b43-be53-2cd093886739 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.198560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.199226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.199545 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.199814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.200624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.203960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.215042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1239/2502] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:09.219719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.230254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32d86-cbd1-4d67-b2bc-556b778b1b03 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.236182 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.237113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.237395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.237655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] PATH_INFO: `/v3/projects/773153d6da2d4fd787a7f613f8322e0d/users/9ad5c098d52546a38df6735cfeb81dc4/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.253684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773153d6da2d4fd787a7f613f8322e0d, user_id=9ad5c098d52546a38df6735cfeb81dc4, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.256417 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.271706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1264/2503] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:09 2022] PUT /identity/v3/projects/773153d6da2d4fd787a7f613f8322e0d/users/9ad5c098d52546a38df6735cfeb81dc4/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:09.276206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.286959 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9640-0bd2-4993-b435-f02cc9f6ca0c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.351367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.352043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.352316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.352595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.353333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.354976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0a78-947a-4a68-b104-10f06754b3a4 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.364803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1240/2504] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:09.369109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.379450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2b7d-9bd5-4943-a6cc-bedaac557052 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.384230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.385236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.385520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.385790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] PATH_INFO: `/v3/projects/773153d6da2d4fd787a7f613f8322e0d/users/9ad5c098d52546a38df6735cfeb81dc4/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.387812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=773153d6da2d4fd787a7f613f8322e0d, user_id=9ad5c098d52546a38df6735cfeb81dc4, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.390510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.401298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1265/2505] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:09 2022] PUT /identity/v3/projects/773153d6da2d4fd787a7f613f8322e0d/users/9ad5c098d52546a38df6735cfeb81dc4/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:09.411436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.412008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.412258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.441719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] MFA Rules not processed for user `9ad5c098d52546a38df6735cfeb81dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:09.442932 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:09.513057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1241/2506] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:09.526164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.528686 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:09.591565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac4ea-5c1a-4890-a5f7-0f8373e7917a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.595586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.596263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.596551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.596822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.606346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.607722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.617084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1266/2507] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:09.701254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:09.711081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba683-2f47-442f-b01c-cf75e5bd192a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:09.715390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:09.716148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:09.716591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:09.716714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:09.774789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:09.776716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fec2f-d362-4ff9-b4ce-536d2f3c7e49 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:09.785601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1242/2508] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:10.066898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:10.129473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22772aef-73f9-4c24-8ad9-720089706c6e service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:10.134568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:10.135490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:10.135772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:10.136046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] PATH_INFO: `/v3/users/d450604f880549dcbd01ef7e57fe58d3` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:10.137263 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d450604f880549dcbd01ef7e57fe58d3)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:10.139181 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:10.191706 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd450604f880549dcbd01ef7e57fe58d3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.204028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd450604f880549dcbd01ef7e57fe58d3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.210617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd450604f880549dcbd01ef7e57fe58d3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.211297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd450604f880549dcbd01ef7e57fe58d3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.221135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd450604f880549dcbd01ef7e57fe58d3'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.227457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1267/2509] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:10 2022] DELETE /identity/v3/users/d450604f880549dcbd01ef7e57fe58d3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:10.232238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:10.232534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:10.232810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:10.250629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:10.251902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:10.313823 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1243/2510] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:10.324600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:10.326261 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:10.394920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48659-b145-44d9-9796-a9b409bf660f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:10.399396 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:10.400096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:10.400372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:10.400629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:10.410765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:10.412234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:10.422488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1268/2511] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:49:10.706329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:10.707862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:10.720470 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccc569-9e27-46b7-8fe7-c07cdba105ca None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:10.725575 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:10.726462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:10.726743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:10.727022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] PATH_INFO: `/v3/projects/2a9db419b3344bc19c6e6ddbe65c3b79` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:10.728261 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9db419b3344bc19c6e6ddbe65c3b79)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:10.730971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:10.780009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9db419b3344bc19c6e6ddbe65c3b79', 'request_id': 'req-5c5e287f-089a-4bee-8943-2b008bd9b673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.785436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9db419b3344bc19c6e6ddbe65c3b79', 'request_id': 'req-5c5e287f-089a-4bee-8943-2b008bd9b673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.794336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9db419b3344bc19c6e6ddbe65c3b79', 'request_id': 'req-5c5e287f-089a-4bee-8943-2b008bd9b673'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.805471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] The token cache is being invalidate because project 2a9db419b3344bc19c6e6ddbe65c3b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:10.805752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.806393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.808070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1244/2512] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:10 2022] DELETE /identity/v3/projects/2a9db419b3344bc19c6e6ddbe65c3b79 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:10.812138 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:10.822077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a639db8-6d96-4d1e-9dd9-8509d9ff526b service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:10.886864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:10.887788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:10.888072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:10.888342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] PATH_INFO: `/v3/users/9ad5c098d52546a38df6735cfeb81dc4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:10.889677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad5c098d52546a38df6735cfeb81dc4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:10.891627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:10.944163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad5c098d52546a38df6735cfeb81dc4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.958856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad5c098d52546a38df6735cfeb81dc4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.966305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad5c098d52546a38df6735cfeb81dc4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.967023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad5c098d52546a38df6735cfeb81dc4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.975609 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d15d3e-126c-4d20-9cdd-df25c4fe1bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad5c098d52546a38df6735cfeb81dc4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:10.982699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1269/2513] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:10 2022] DELETE /identity/v3/users/9ad5c098d52546a38df6735cfeb81dc4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:11.267174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.268853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:11.284942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e287f-089a-4bee-8943-2b008bd9b673 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.344675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.345544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.345820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.346094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] PATH_INFO: `/v3/projects/773153d6da2d4fd787a7f613f8322e0d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.347282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773153d6da2d4fd787a7f613f8322e0d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.349241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.405519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773153d6da2d4fd787a7f613f8322e0d', 'request_id': 'req-cd7670a0-bb0c-4315-a6f9-1b82dd691097'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:11.411371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773153d6da2d4fd787a7f613f8322e0d', 'request_id': 'req-cd7670a0-bb0c-4315-a6f9-1b82dd691097'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:11.420758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773153d6da2d4fd787a7f613f8322e0d', 'request_id': 'req-cd7670a0-bb0c-4315-a6f9-1b82dd691097'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:11.431667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] The token cache is being invalidate because project 773153d6da2d4fd787a7f613f8322e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:11.431977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:11.432584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7670a0-bb0c-4315-a6f9-1b82dd691097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:11.434129 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1245/2514] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:11 2022] DELETE /identity/v3/projects/773153d6da2d4fd787a7f613f8322e0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:11.439857 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.440355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.440453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.459277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:11.460420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:11.520239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1270/2515] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:11.530415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.530697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.530969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.550263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:11.551441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:11.559952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1246/2516] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:11.564485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.579549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8000-4133-44e6-9c82-cb0422ff79ea None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.587015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.587720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.588021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.588297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.589170 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:11.589523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.591245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.604481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1271/2517] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:11.611253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.624548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708b59d-2138-4a94-a68c-f12139871395 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.630461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.631120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.631399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.631667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.632463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.634376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.668280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1247/2518] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:11 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:11.672574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.682928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c5ed3-d62a-4263-88eb-f1971b083893 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.741529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.742118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.742397 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.742674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.743385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.745356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.766809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1272/2519] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:11 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:11.770986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.781216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3685-64f3-4b92-978e-4d24782306a0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.786066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.786728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.787004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.787276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.788023 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.789624 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.800206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1248/2520] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:11.804245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.815221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fca74-9bb3-4754-87bd-2e92d3957394 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.819935 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.820586 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.820872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.821134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.821883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.824217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6542a-ef5f-49bb-bb04-9b64b5e843aa admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.835292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1273/2521] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:49:11.838821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:11.848983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b54d9-d69f-4db4-838b-9c2aa4d43965 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:11.853694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:11.854558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.854877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.855311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] PATH_INFO: `/v3/projects/ecc72607b1124a3cb94020fafdfde4be/users/73e661189f9b4b268086741c0f03f080/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.870082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc72607b1124a3cb94020fafdfde4be, user_id=73e661189f9b4b268086741c0f03f080, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:11.872905 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:11.893127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1249/2522] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:11 2022] PUT /identity/v3/projects/ecc72607b1124a3cb94020fafdfde4be/users/73e661189f9b4b268086741c0f03f080/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:11.904779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:11.905068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:11.905341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:11.933251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] MFA Rules not processed for user `73e661189f9b4b268086741c0f03f080`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:11.934492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:12.000177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1274/2523] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:12.015407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:12.017276 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:12.076292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978dd9-1ad2-49df-8718-7dc569d85505 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:12.080523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:12.081180 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:12.081459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:12.081736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:12.092034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:12.093480 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280fa7-24b2-48ee-b8c5-f78d41df725d service glance] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:12.102642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1250/2524] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:49:16.341082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:16.342668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:16.418528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2decd-448c-4259-9749-41742ce91c52 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:16.423724 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:16.424631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:16.424918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:16.425194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] PATH_INFO: `/v3/users/cf03e74dc4cf4f53b0af2ff45b9cd72d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:16.426479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf03e74dc4cf4f53b0af2ff45b9cd72d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:16.428493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:16.480740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf03e74dc4cf4f53b0af2ff45b9cd72d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:16.492340 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf03e74dc4cf4f53b0af2ff45b9cd72d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:16.499967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf03e74dc4cf4f53b0af2ff45b9cd72d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:16.500770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf03e74dc4cf4f53b0af2ff45b9cd72d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:16.509920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf03e74dc4cf4f53b0af2ff45b9cd72d'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:16.516440 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1275/2525] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:16 2022] DELETE /identity/v3/users/cf03e74dc4cf4f53b0af2ff45b9cd72d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:16.521079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:16.521595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:16.521595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:16.539387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:16.540623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:16.604721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1251/2526] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:16.614723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:16.616248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:16.681447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ed6f0-8c4a-475a-814d-12ad3864baf6 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:16.687461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:16.688127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:16.688413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:16.688682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:16.702343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:16.704795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:16.718803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1276/2527] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:16.993633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:16.995195 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:17.010192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a68f7e-8b4f-4972-8d7d-4d697a4e4f92 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:17.016269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:17.017081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.017346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.017628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] PATH_INFO: `/v3/projects/eaca5bd74c514902a45da109a0d7df96` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.018866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaca5bd74c514902a45da109a0d7df96)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:17.020824 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:17.069634 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaca5bd74c514902a45da109a0d7df96', 'request_id': 'req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.075872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaca5bd74c514902a45da109a0d7df96', 'request_id': 'req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.084381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaca5bd74c514902a45da109a0d7df96', 'request_id': 'req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.096018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] The token cache is being invalidate because project eaca5bd74c514902a45da109a0d7df96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:17.096316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.097017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.098736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1252/2528] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:16 2022] DELETE /identity/v3/projects/eaca5bd74c514902a45da109a0d7df96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:17.102932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:17.116114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a213f3-3e42-4f96-96e0-34fcd3517529 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:17.179973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:17.181235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.181606 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.181958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] PATH_INFO: `/v3/users/fa0178b09ba044dbb276ae2468abf37a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.183673 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0178b09ba044dbb276ae2468abf37a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:17.185714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:17.233395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0178b09ba044dbb276ae2468abf37a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.244763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0178b09ba044dbb276ae2468abf37a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.251347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0178b09ba044dbb276ae2468abf37a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.252032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0178b09ba044dbb276ae2468abf37a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.261705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-402fea9c-cee6-48ee-a020-3af3933c92d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0178b09ba044dbb276ae2468abf37a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.270056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1277/2529] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:17 2022] DELETE /identity/v3/users/fa0178b09ba044dbb276ae2468abf37a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:17.564845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:17.566287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:17.584507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e7ee5-15e1-4fdd-8a32-2f6f3796bc71 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:17.643066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:17.643975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.644252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.644520 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] PATH_INFO: `/v3/projects/773f82e7dfbc4765b77f4530e045ccdc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.645712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773f82e7dfbc4765b77f4530e045ccdc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:17.647643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:17.697218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773f82e7dfbc4765b77f4530e045ccdc', 'request_id': 'req-f27eac42-0f80-45c7-b40e-236970014a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.703309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773f82e7dfbc4765b77f4530e045ccdc', 'request_id': 'req-f27eac42-0f80-45c7-b40e-236970014a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.713360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773f82e7dfbc4765b77f4530e045ccdc', 'request_id': 'req-f27eac42-0f80-45c7-b40e-236970014a92'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.724600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] The token cache is being invalidate because project 773f82e7dfbc4765b77f4530e045ccdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:17.724883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.725523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f27eac42-0f80-45c7-b40e-236970014a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:17.727115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1253/2530] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:17 2022] DELETE /identity/v3/projects/773f82e7dfbc4765b77f4530e045ccdc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:17.732969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.733508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.733508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.751554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:17.752762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:17.820283 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1278/2531] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:17.828648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.828937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.829216 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.847775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:17.848969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:17.857101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1254/2532] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:17.861399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:17.871195 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded72d0-a3c0-4950-9293-d599d58dcf12 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:17.876160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:17.876819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.877101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.877374 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.878101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:17.878411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:17.880047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:17.891727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1279/2533] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:17.895946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:17.905110 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ecee-6635-4a55-bfcb-1e97481123e1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:17.910537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:17.911190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:17.911468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:17.911731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:17.912462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:17.914373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:17.944040 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1255/2534] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:17 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:17.948603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:17.961251 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df60424-e552-4ff2-9c28-0e36db52c8ce admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.023292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.023909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.024191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.024470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.025132 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.027174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.049928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1280/2535] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:17 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:18.054245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.064881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2a33-8f5a-4c63-b464-6117a227e405 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.070341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.071009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.071287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.071560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.072318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.073945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.085368 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1256/2536] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:18.091231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.106950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e942b2-7966-4998-9a6f-f83a7622f025 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.114881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.115907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.116306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.116595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.117671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.120236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7760579-27f4-4bb7-ae28-3d9c64dd2d58 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.130951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1281/2537] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:18.135330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.146471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ef7-913b-461d-b863-e7ba88b9d20f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.152249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.153178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.153457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.153726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] PATH_INFO: `/v3/projects/48c73402dbe04c459dd28225b0fd3140/users/583190b450f8423ab9876c93c447ef01/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.170946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c73402dbe04c459dd28225b0fd3140, user_id=583190b450f8423ab9876c93c447ef01, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.173692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.188237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1257/2538] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:18 2022] PUT /identity/v3/projects/48c73402dbe04c459dd28225b0fd3140/users/583190b450f8423ab9876c93c447ef01/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:18.198677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.198969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.199281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.231880 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] MFA Rules not processed for user `583190b450f8423ab9876c93c447ef01`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:18.233335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:18.301882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1282/2539] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:18.308803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.382847 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cba31-32ae-4400-8b40-76c5b227a643 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.388215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.388874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.389151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.389418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.390107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.392042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.421598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1258/2540] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:18 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:18.425745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.437551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1435c12-9daa-414f-8624-0fdc0cf1db89 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.499980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.500688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.500965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.501230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.501982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.503989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.530875 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1283/2541] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:18 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:18.535792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.548973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4bf13-2dd3-4c1f-b3a1-72a612e9a748 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.554076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.554678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.554955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.555337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.556102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.557733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.568287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1259/2542] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:18.572850 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.584226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d954a-5e89-49dc-b500-a4d798b09838 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.590974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.592357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.592756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.593165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] PATH_INFO: `/v3/projects/0c32e1b555584f90af0d38cc0df5df8a/users/5b6ad81a04ad49feabef475f30a7757d/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.610198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c32e1b555584f90af0d38cc0df5df8a, user_id=5b6ad81a04ad49feabef475f30a7757d, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.613214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.628325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1284/2543] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:18 2022] PUT /identity/v3/projects/0c32e1b555584f90af0d38cc0df5df8a/users/5b6ad81a04ad49feabef475f30a7757d/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:18.633116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.644587 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26efd0-83dc-42c8-ada1-1f074b5d0e43 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.712066 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.712751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.713042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.713312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.714124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.715754 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f441c5a-b60c-434d-a28e-be89990b605e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.726815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1260/2544] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:49:18.731510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.742602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059f67-bfdd-4cee-9a10-e78880367da4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.750454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.751512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.751905 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.752229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] PATH_INFO: `/v3/projects/0c32e1b555584f90af0d38cc0df5df8a/users/5b6ad81a04ad49feabef475f30a7757d/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.755250 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c32e1b555584f90af0d38cc0df5df8a, user_id=5b6ad81a04ad49feabef475f30a7757d, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.758489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.772545 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1285/2545] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:18 2022] PUT /identity/v3/projects/0c32e1b555584f90af0d38cc0df5df8a/users/5b6ad81a04ad49feabef475f30a7757d/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:18.784550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.784819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.785096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.814491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] MFA Rules not processed for user `5b6ad81a04ad49feabef475f30a7757d`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:18.816160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:18.888845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1261/2546] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:18.900538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:18.902737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:18.963675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791291-6a97-4383-a242-2e058a024acc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:18.968235 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:18.968989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:18.969269 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:18.969568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:18.980924 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:18.982400 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:18.993458 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1286/2547] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:19.067780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:19.078400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4a3a1-58e0-4b57-ac8f-aa5a41821889 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:19.082730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:19.083388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:19.083671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:19.083983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:19.144700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:19.146150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:19.155108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1262/2548] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:19.936525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:19.939045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:20.021627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa3c9-3748-455c-b8b3-560f88430bb9 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:20.028272 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:20.028937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:20.029221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:20.029491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:20.031662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:20.120648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:20.122384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8356c-faea-4a5f-aa3e-324420215d20 service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:20.141787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1287/2549] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:34.871178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.962025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfab39d-3935-4da8-9876-0b422c4b76ff service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.966717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.967609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.967917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.968191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] PATH_INFO: `/v3/users/583190b450f8423ab9876c93c447ef01` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.969371 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583190b450f8423ab9876c93c447ef01)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.971329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.029805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583190b450f8423ab9876c93c447ef01'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.043493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583190b450f8423ab9876c93c447ef01'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.044217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583190b450f8423ab9876c93c447ef01'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.044827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583190b450f8423ab9876c93c447ef01'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.053594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583190b450f8423ab9876c93c447ef01'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.066485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1263/2550] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:34 2022] DELETE /identity/v3/users/583190b450f8423ab9876c93c447ef01 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:35.071636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.072233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.072233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.105474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:35.106674 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.176973 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1288/2551] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:35.188188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.190567 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.276230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2065b-1150-4e86-8b78-f779e96f7d37 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.280792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.281080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.281294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.281561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.292173 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.293680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.303439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1264/2552] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:35.581714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.583184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.598056 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258066-789c-425b-b873-c3aa1866a9c9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.604971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.605877 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.606200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.606385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] PATH_INFO: `/v3/projects/48c73402dbe04c459dd28225b0fd3140` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.607708 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c73402dbe04c459dd28225b0fd3140)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.609657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.661566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c73402dbe04c459dd28225b0fd3140', 'request_id': 'req-96ffe03a-468e-40e4-892b-620173014fe7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.667365 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c73402dbe04c459dd28225b0fd3140', 'request_id': 'req-96ffe03a-468e-40e4-892b-620173014fe7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.676809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c73402dbe04c459dd28225b0fd3140', 'request_id': 'req-96ffe03a-468e-40e4-892b-620173014fe7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.689106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] The token cache is being invalidate because project 48c73402dbe04c459dd28225b0fd3140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:35.689393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.690113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.691789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1289/2553] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:35 2022] DELETE /identity/v3/projects/48c73402dbe04c459dd28225b0fd3140 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:35.696373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.706096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4694-2a06-4303-8e35-e933f69bd0ea service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.765453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.766344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.766612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.766918 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] PATH_INFO: `/v3/users/5b6ad81a04ad49feabef475f30a7757d` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.768259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6ad81a04ad49feabef475f30a7757d)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.770176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.823199 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6ad81a04ad49feabef475f30a7757d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.836945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6ad81a04ad49feabef475f30a7757d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.837666 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6ad81a04ad49feabef475f30a7757d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.838292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6ad81a04ad49feabef475f30a7757d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.848256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-85e538b5-154a-4e99-bebc-3ccc7657e63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6ad81a04ad49feabef475f30a7757d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:35.861821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1265/2554] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:35 2022] DELETE /identity/v3/users/5b6ad81a04ad49feabef475f30a7757d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:36.132642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.134329 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.149117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe03a-468e-40e4-892b-620173014fe7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.208911 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.209794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.210071 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.210342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] PATH_INFO: `/v3/projects/0c32e1b555584f90af0d38cc0df5df8a` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.211518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c32e1b555584f90af0d38cc0df5df8a)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.213476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.264574 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c32e1b555584f90af0d38cc0df5df8a', 'request_id': 'req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.270335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c32e1b555584f90af0d38cc0df5df8a', 'request_id': 'req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.280093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c32e1b555584f90af0d38cc0df5df8a', 'request_id': 'req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.294146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] The token cache is being invalidate because project 0c32e1b555584f90af0d38cc0df5df8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:36.294470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.295213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-dfe51311-b0fb-4b02-8cbe-f5fb972fda73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.296970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1290/2555] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:36 2022] DELETE /identity/v3/projects/0c32e1b555584f90af0d38cc0df5df8a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:36.302252 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.302785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.302882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.320922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:36.322107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.387065 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1266/2556] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:36.395288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.395575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.395861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.414870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:36.416136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.426116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1291/2557] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:36.430793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.441194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9d09-0336-4d47-86b5-6d38bb18753a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.446378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.447061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.450270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.450581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.451373 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:36.451716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.454055 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.467958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1267/2558] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:36.472106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.481785 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9502b6-ba1e-4df4-9a88-ee78de6780e5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.489794 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.490943 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.491455 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.492018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.493355 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.497164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.528497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1292/2559] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:36.530008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.540809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e037fa-2f8d-4a41-82ce-2dfe910989a0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.598643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.599332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.599615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.599917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.600616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.602550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.625570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1268/2560] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:36.629671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.640518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2a5d-3a90-47ef-9470-0e905653df42 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.645232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.646296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.646484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.646834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.647642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.649375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.662115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1293/2561] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:49:36.666867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.677356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1f6b-d509-4b88-ae84-7b3e02659443 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.682112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.682746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.683024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.683297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.684051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.685647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825b44b-19fb-4c2f-92ce-bc392d043567 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.700071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1269/2562] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:36.701464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.712157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc91c-1aa5-42f7-b540-a1b790f790a4 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.717050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.718014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.718388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.718725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] PATH_INFO: `/v3/projects/296e75a084e342b5b8fa2ff6d16be66e/users/6a091f2317264468af17309bc68ded48/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.739021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296e75a084e342b5b8fa2ff6d16be66e, user_id=6a091f2317264468af17309bc68ded48, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.741963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.776118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1294/2563] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:36 2022] PUT /identity/v3/projects/296e75a084e342b5b8fa2ff6d16be66e/users/6a091f2317264468af17309bc68ded48/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:36.777955 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.778242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.778518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.809582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] MFA Rules not processed for user `6a091f2317264468af17309bc68ded48`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:36.811071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.877265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1270/2564] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:36.878531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.941274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc19d-bc27-45ff-b73a-244c70b8e1c0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.946298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.947008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.947292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.947568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.948302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.950262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.977348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1295/2565] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:36.981429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.994629 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece65529-c076-4a44-a31d-bc2171c84b16 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.053962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.054692 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.055009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.055285 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.056148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.058079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.079737 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1271/2566] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:37.084067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.099722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2f651-0c62-452d-9387-5364e3484e63 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.105214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.105915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.106211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.106477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.107820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.109353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.121791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1296/2567] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:37.126562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.137944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dd6e2-0490-4b18-8729-88dc9ea40ebf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.142613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.143511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.143825 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.144106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] PATH_INFO: `/v3/projects/d4f95073b896492d8cb5fd94151b4d49/users/3d542ab9d9184a9f92205d896a2b9fcb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.160743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f95073b896492d8cb5fd94151b4d49, user_id=3d542ab9d9184a9f92205d896a2b9fcb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.164210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.177622 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1272/2568] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:37 2022] PUT /identity/v3/projects/d4f95073b896492d8cb5fd94151b4d49/users/3d542ab9d9184a9f92205d896a2b9fcb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:37.181734 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.191649 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e1c7-e228-4ba0-b3cc-7dc24618f6a7 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.247312 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.248015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.248296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.248573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.249276 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.250919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa4fad-8ccd-4670-9a4a-5ece3d742855 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.260923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1297/2569] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:49:37.265332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.275968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619974f-60c1-445e-9b18-cbca7ae4b0f7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.280910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.281814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.282096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.282495 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] PATH_INFO: `/v3/projects/d4f95073b896492d8cb5fd94151b4d49/users/3d542ab9d9184a9f92205d896a2b9fcb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.284590 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f95073b896492d8cb5fd94151b4d49, user_id=3d542ab9d9184a9f92205d896a2b9fcb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.287561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.298387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1273/2570] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:37 2022] PUT /identity/v3/projects/d4f95073b896492d8cb5fd94151b4d49/users/3d542ab9d9184a9f92205d896a2b9fcb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:37.310066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.310390 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.310693 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.350543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] MFA Rules not processed for user `3d542ab9d9184a9f92205d896a2b9fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:37.350543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.383715 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.385457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.450792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1298/2571] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:37.458872 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.460350 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.472383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d3d92-e57d-47dc-8fb2-14e3c3b8df66 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.478683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.479532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.479861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.480144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.482448 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.495903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.497719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.509910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1274/2572] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:49:37.553685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cdc63-7e64-4ffa-8b25-4b4987beb870 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.558248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.559106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.559454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.559955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.579469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.581784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.597833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1299/2573] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:49:37.648256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.649752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.664080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127456f-d09f-441b-99ca-d0cb523d4dcc service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.668133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.668797 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.669079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.669358 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.731668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.733290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e8564-e648-49da-a778-ba2cb79ab71d service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.744820 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1275/2574] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:49:41.119395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:41.211481 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9867832-dc6f-4892-8a6c-9add3040cba4 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:41.216727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:41.217882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:41.218158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:41.218610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] PATH_INFO: `/v3/users/6a091f2317264468af17309bc68ded48` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:41.220049 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a091f2317264468af17309bc68ded48)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:41.222314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:41.271963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a091f2317264468af17309bc68ded48'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.284289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a091f2317264468af17309bc68ded48'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.293881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a091f2317264468af17309bc68ded48'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.294656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a091f2317264468af17309bc68ded48'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.303538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a091f2317264468af17309bc68ded48'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.311008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1300/2575] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:41 2022] DELETE /identity/v3/users/6a091f2317264468af17309bc68ded48 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:41.315559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:41.316109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:41.316200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:41.364440 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:41.365691 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:41.426438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1276/2576] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:41.437575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:41.439895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:41.534605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6d725-3d28-4774-9c6e-8f290fc81463 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:41.539231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:41.540171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:41.540553 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:41.540835 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:41.550514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:41.551999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:41.561385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1301/2577] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:41.839153 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:41.841576 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:41.859399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ee42-c5cf-4650-8407-2398b2e88ed2 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:41.865053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:41.866008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:41.866284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:41.866554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] PATH_INFO: `/v3/projects/296e75a084e342b5b8fa2ff6d16be66e` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:41.868081 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296e75a084e342b5b8fa2ff6d16be66e)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:41.870275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:41.927304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296e75a084e342b5b8fa2ff6d16be66e', 'request_id': 'req-f658e55d-3c7b-4da8-96ee-721f9334b1e0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.933878 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296e75a084e342b5b8fa2ff6d16be66e', 'request_id': 'req-f658e55d-3c7b-4da8-96ee-721f9334b1e0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.943778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296e75a084e342b5b8fa2ff6d16be66e', 'request_id': 'req-f658e55d-3c7b-4da8-96ee-721f9334b1e0'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.957606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] The token cache is being invalidate because project 296e75a084e342b5b8fa2ff6d16be66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:41.957958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.958641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:41.964163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1277/2578] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:41 2022] DELETE /identity/v3/projects/296e75a084e342b5b8fa2ff6d16be66e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:41.965475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:41.980158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d15fe-2d48-4c92-982b-22272779b16a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.036701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.037670 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.037949 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.038220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] PATH_INFO: `/v3/users/3d542ab9d9184a9f92205d896a2b9fcb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.039486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d542ab9d9184a9f92205d896a2b9fcb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.041777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.095026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d542ab9d9184a9f92205d896a2b9fcb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.108369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d542ab9d9184a9f92205d896a2b9fcb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.113220 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d542ab9d9184a9f92205d896a2b9fcb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.113922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d542ab9d9184a9f92205d896a2b9fcb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.125398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-4d02e993-79fe-4f6c-aca7-491cb20950fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d542ab9d9184a9f92205d896a2b9fcb'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.133372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1302/2579] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:41 2022] DELETE /identity/v3/users/3d542ab9d9184a9f92205d896a2b9fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:42.402804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.404301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:42.417812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e55d-3c7b-4da8-96ee-721f9334b1e0 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.474853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.475770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.476086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.476356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] PATH_INFO: `/v3/projects/d4f95073b896492d8cb5fd94151b4d49` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.477589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f95073b896492d8cb5fd94151b4d49)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.479494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.526384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f95073b896492d8cb5fd94151b4d49', 'request_id': 'req-d66171fd-7987-45d6-846e-328b6fffe854'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.531530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f95073b896492d8cb5fd94151b4d49', 'request_id': 'req-d66171fd-7987-45d6-846e-328b6fffe854'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.539191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f95073b896492d8cb5fd94151b4d49', 'request_id': 'req-d66171fd-7987-45d6-846e-328b6fffe854'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.550828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] The token cache is being invalidate because project d4f95073b896492d8cb5fd94151b4d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:42.551105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.551819 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-d66171fd-7987-45d6-846e-328b6fffe854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:42.553416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1278/2580] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:42 2022] DELETE /identity/v3/projects/d4f95073b896492d8cb5fd94151b4d49 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:42.559356 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.559662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.560339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.606301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:42.607514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:42.676079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1303/2581] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:42.688683 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.688943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.689484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.711042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:42.712853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:42.721837 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1279/2582] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:42.726370 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.737372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097693-6cef-432d-a533-223257ecfcc6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.743080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.743754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.744066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.744341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.745072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:42.745378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.746993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.759869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1304/2583] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:49:42.764390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.773746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc46a-e937-4cf2-bf8a-0055406d697f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.779088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.779785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.780061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.780350 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.781054 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.782974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.813114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1280/2584] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:42 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:42.816765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.827409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc894c-3580-44e7-8ce2-5910f2f9bb2d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.901866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.902546 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.902824 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.903093 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.903821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.905741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.929449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1305/2585] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:42 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:42.933773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.944289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142072e-cd35-46ac-9c44-9477c2ee8ac1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.949184 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.949856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.950140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.950417 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.951145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.952783 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.963301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1281/2586] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:42.967293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:42.978174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b326df-6187-4195-9225-4e5773c515e9 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:42.983534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:42.984234 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:42.984518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:42.984791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:42.985525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:42.987145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c4086-b5da-417a-92df-b870e9d685da admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:42.997200 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1306/2587] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:43.001418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.012056 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819032f4-ae51-4be8-8f00-f838ec02122a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.017296 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.018190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.018467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.018740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] PATH_INFO: `/v3/projects/87584af81d14465f8bd6f9218ff48827/users/b50da124c4464b9ea14ada30990db039/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.033860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87584af81d14465f8bd6f9218ff48827, user_id=b50da124c4464b9ea14ada30990db039, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.036549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.051516 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1282/2588] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:43 2022] PUT /identity/v3/projects/87584af81d14465f8bd6f9218ff48827/users/b50da124c4464b9ea14ada30990db039/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:43.062503 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.062772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.063041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.092339 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] MFA Rules not processed for user `b50da124c4464b9ea14ada30990db039`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:43.093770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:43.161605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1307/2589] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:43.167397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.236167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05e3c-5f05-472a-9803-ad32e6fb9151 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.241981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.242655 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.243045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.243418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.244405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.247068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.278457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1283/2590] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:43 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:43.282721 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.294347 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db621-ac89-4547-9ee9-c578d1444e6b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.356763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.357444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.357738 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.358001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.358691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.360659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.382528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1308/2591] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:43 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:43.387042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.397444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9c5e-415f-4944-8c65-7f1d8675a40b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.403732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.404472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.404765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.405047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.405782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.407429 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.419322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1284/2592] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:43.423754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.434548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a02f-15eb-47e0-998b-4dafb433b75d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.439245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.440216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.440527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.440803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] PATH_INFO: `/v3/projects/269cc7845ff84858897b73901439f2b8/users/c0c251ba18a94005a97f458c4c34d869/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.456630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=269cc7845ff84858897b73901439f2b8, user_id=c0c251ba18a94005a97f458c4c34d869, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.459293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.473719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1309/2593] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:43 2022] PUT /identity/v3/projects/269cc7845ff84858897b73901439f2b8/users/c0c251ba18a94005a97f458c4c34d869/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:43.477877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.488614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb1cc9-ac63-4ddf-85f9-ea6fc17620d5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.546740 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.547441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.547705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.548026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.548733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.550376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83033c64-5b2c-4e4b-a0e8-2263c4c028ac admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.561815 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1285/2594] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:43.568675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.580725 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cf8e-4acc-42c0-b174-de768f8e1f6e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.588375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.589570 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.589964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.590336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] PATH_INFO: `/v3/projects/269cc7845ff84858897b73901439f2b8/users/c0c251ba18a94005a97f458c4c34d869/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.593965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269cc7845ff84858897b73901439f2b8, user_id=c0c251ba18a94005a97f458c4c34d869, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.598145 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.611575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1310/2595] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:43 2022] PUT /identity/v3/projects/269cc7845ff84858897b73901439f2b8/users/c0c251ba18a94005a97f458c4c34d869/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:43.628896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.629658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.629658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.664462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] MFA Rules not processed for user `c0c251ba18a94005a97f458c4c34d869`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:43.666255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:43.736829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1286/2596] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:43.748149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:43.750260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:43.811720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b794-94bf-4b15-bdc9-10f4efe642c8 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:43.816060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:43.816747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:43.817024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:43.817304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:43.881459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:43.882921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:43.892408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1311/2597] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:49.635348 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:49.637038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:49.712924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0643b0-969a-455d-9ca1-dceaf0145259 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:49.717842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:49.718506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:49.718791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:49.719064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:49.721141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:49.786411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:49.787887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:49.798534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1287/2598] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:53.248479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:53.250032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:53.269042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886b8d-eae7-46dc-abea-59e5ad2a25bf service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:53.274227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:53.275749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.275749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.276081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] PATH_INFO: `/v3/users/ab522f0209154f959a431caa01f3a029` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.277840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab522f0209154f959a431caa01f3a029)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:53.279830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:53.330332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab522f0209154f959a431caa01f3a029'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.342224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab522f0209154f959a431caa01f3a029'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.349076 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab522f0209154f959a431caa01f3a029'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.349798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab522f0209154f959a431caa01f3a029'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.359334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d805562a-250c-47e2-960f-7cb237d9f6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab522f0209154f959a431caa01f3a029'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.366306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1312/2599] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:49:53 2022] DELETE /identity/v3/users/ab522f0209154f959a431caa01f3a029 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:53.567152 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:53.578821 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810c06-ebdd-4540-94c4-6baf1ccace23 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:53.643084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:53.644010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.644287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.644557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] PATH_INFO: `/v3/projects/9794155ca0aa4b75a153f0640e068ff5` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.645813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9794155ca0aa4b75a153f0640e068ff5)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:53.647774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:53.695893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9794155ca0aa4b75a153f0640e068ff5', 'request_id': 'req-57a5d90c-fdf3-46f0-947b-31e921eabab3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.701046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9794155ca0aa4b75a153f0640e068ff5', 'request_id': 'req-57a5d90c-fdf3-46f0-947b-31e921eabab3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.709869 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9794155ca0aa4b75a153f0640e068ff5', 'request_id': 'req-57a5d90c-fdf3-46f0-947b-31e921eabab3'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.720782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] The token cache is being invalidate because project 9794155ca0aa4b75a153f0640e068ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:53.721061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.721701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-57a5d90c-fdf3-46f0-947b-31e921eabab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:53.723304 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1288/2600] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:49:53 2022] DELETE /identity/v3/projects/9794155ca0aa4b75a153f0640e068ff5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:53.731204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.731595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.732025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.755135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:53.756369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:53.819714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1313/2601] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:53.828669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.829210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.829483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.856991 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:53.858218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:53.868046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1289/2602] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:53.872960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:53.883198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc6db-556b-477c-b217-0b2664966162 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:53.889225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:53.889921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.890205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.890468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.891198 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:53.891498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:53.893123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:53.905360 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1314/2603] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:53.909986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:53.919546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6814-2b48-4c0e-b97d-b059124df913 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:53.924653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:53.925306 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:53.925581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:53.925852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:53.926538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:53.928488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:53.956665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1290/2604] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:49:53 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:53.960906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:53.971006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8867d3-6cd8-407c-9f32-6065de00c4ec admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.032557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.033237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.033517 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.033787 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.034476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.036471 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.058647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1315/2605] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:49:53 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:54.063380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:54.077648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513397e-548b-4327-ab80-a58b70933017 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.084841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.085806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.086245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.086647 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.087604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.090311 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.104375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1291/2606] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:49:54.108902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:54.119509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac01008-0219-47a3-9583-f17425ccbfad admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.125953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.126631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.126908 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.127177 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.128314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.130364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290028-a293-4f07-9692-9472bc037a56 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.142264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1316/2607] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:54.148757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:54.159962 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b29689-ab7a-4f20-bec3-6b1d96b1742e admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.165674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.166896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.167178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.167449 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] PATH_INFO: `/v3/projects/ecb9b62ba1dd4a4f8ec5ca3886b97df3/users/18ba79ecb61c4c9996aa48eeee89429e/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.183759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb9b62ba1dd4a4f8ec5ca3886b97df3, user_id=18ba79ecb61c4c9996aa48eeee89429e, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.186463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.201953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1292/2608] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:49:54 2022] PUT /identity/v3/projects/ecb9b62ba1dd4a4f8ec5ca3886b97df3/users/18ba79ecb61c4c9996aa48eeee89429e/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:54.213840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.214232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.214518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.241564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] MFA Rules not processed for user `18ba79ecb61c4c9996aa48eeee89429e`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:54.242755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:54.315162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1317/2609] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:54.327201 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:54.329411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:54.386641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e8944-de90-4b8c-b9ca-64546b6005c1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.390948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.391605 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.391914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.392194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.401392 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.402780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.412217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1293/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:54.563162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:54.564562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:54.576341 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4101d-7e17-44f0-8fb8-8921cf22649c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:54.580016 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:54.580668 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:54.580939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:54.581211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:54.583078 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:54.648125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:54.649420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0af2e-bf10-4476-b51e-f873ce70dc1d service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:54.660114 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1318/2611] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:03.756225 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:03.758053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:03.838547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfb7e-44e6-441e-83fd-c597e8926696 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:03.844954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:03.846172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:03.846584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:03.846948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] PATH_INFO: `/v3/users/b50da124c4464b9ea14ada30990db039` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:03.848308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50da124c4464b9ea14ada30990db039)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:03.850759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:03.898900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50da124c4464b9ea14ada30990db039'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:03.911377 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50da124c4464b9ea14ada30990db039'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:03.912059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50da124c4464b9ea14ada30990db039'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:03.912745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50da124c4464b9ea14ada30990db039'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:03.921949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50da124c4464b9ea14ada30990db039'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:03.935636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1294/2612] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:03 2022] DELETE /identity/v3/users/b50da124c4464b9ea14ada30990db039 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:03.940336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:03.940823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:03.940947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:03.959030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:03.960287 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.026979 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1319/2613] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:04.037122 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:04.038860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.111986 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f1726-b8fe-4e6d-a0dd-1009338b0300 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:04.115753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:04.116446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.116723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.116992 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.126700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:04.128188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:04.137822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1295/2614] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:04.421303 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:04.422897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.439469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57784494-bdd3-43e2-b4f0-c2634c08eff6 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:04.445128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:04.446180 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.446295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.446505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] PATH_INFO: `/v3/projects/87584af81d14465f8bd6f9218ff48827` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.447838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87584af81d14465f8bd6f9218ff48827)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:04.449717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:04.503127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87584af81d14465f8bd6f9218ff48827', 'request_id': 'req-a0465e68-4c74-4fcb-a047-82d160eb1876'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.508981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87584af81d14465f8bd6f9218ff48827', 'request_id': 'req-a0465e68-4c74-4fcb-a047-82d160eb1876'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.518153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87584af81d14465f8bd6f9218ff48827', 'request_id': 'req-a0465e68-4c74-4fcb-a047-82d160eb1876'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.530513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] The token cache is being invalidate because project 87584af81d14465f8bd6f9218ff48827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:04.530806 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.531496 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.533193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1320/2615] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:04 2022] DELETE /identity/v3/projects/87584af81d14465f8bd6f9218ff48827 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:04.538785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:04.549030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc1066-b64c-4c08-8fc6-0b967e3f0f2a service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:04.588536 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:04.590255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.608352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:04.609251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.609528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.609804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] PATH_INFO: `/v3/users/c0c251ba18a94005a97f458c4c34d869` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.611047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c251ba18a94005a97f458c4c34d869)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:04.613031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:04.657957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465e68-4c74-4fcb-a047-82d160eb1876 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:04.661119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c251ba18a94005a97f458c4c34d869'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.662561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:04.663445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.663804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.664077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] PATH_INFO: `/v3/users/73e661189f9b4b268086741c0f03f080` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.665434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e661189f9b4b268086741c0f03f080)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:04.667990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:04.673933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c251ba18a94005a97f458c4c34d869'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.674667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c251ba18a94005a97f458c4c34d869'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.675391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c251ba18a94005a97f458c4c34d869'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.683459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-47d6d90d-1129-4963-be20-e15238735b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c251ba18a94005a97f458c4c34d869'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.696565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1296/2616] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:04 2022] DELETE /identity/v3/users/c0c251ba18a94005a97f458c4c34d869 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:04.717473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e661189f9b4b268086741c0f03f080'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.728966 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e661189f9b4b268086741c0f03f080'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.735987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e661189f9b4b268086741c0f03f080'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.736944 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e661189f9b4b268086741c0f03f080'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.744551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e661189f9b4b268086741c0f03f080'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:04.752238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1321/2617] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:04 2022] DELETE /identity/v3/users/73e661189f9b4b268086741c0f03f080 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:04.756842 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.757329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.757439 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.777320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:04.778543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.843403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1297/2618] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:04.853446 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:04.854864 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:04.913927 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1a94-eacb-4585-8e21-832795dd1741 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:04.918375 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:04.918688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:04.918999 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:04.919448 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:04.929963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:04.931643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e29573-765f-4f9d-849b-291cd3120d75 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:04.942270 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1322/2619] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:05.015049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.016502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.028957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdd3d-ad59-45c0-90c0-cfa25d6e9af4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.037953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.039649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.040155 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.040682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] PATH_INFO: `/v3/projects/269cc7845ff84858897b73901439f2b8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.043733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269cc7845ff84858897b73901439f2b8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.046765 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.093773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269cc7845ff84858897b73901439f2b8', 'request_id': 'req-68115ff5-ad4a-491b-8e44-a16c1b0541b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.099399 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269cc7845ff84858897b73901439f2b8', 'request_id': 'req-68115ff5-ad4a-491b-8e44-a16c1b0541b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.107446 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269cc7845ff84858897b73901439f2b8', 'request_id': 'req-68115ff5-ad4a-491b-8e44-a16c1b0541b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.118664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] The token cache is being invalidate because project 269cc7845ff84858897b73901439f2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:05.118956 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.119609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-68115ff5-ad4a-491b-8e44-a16c1b0541b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.124535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1298/2620] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:05 2022] DELETE /identity/v3/projects/269cc7845ff84858897b73901439f2b8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:05.130703 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.131117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.132070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.161297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.162736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.224031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1323/2621] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:05.232752 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.233044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.233329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.258204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.259423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.264951 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.266700 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.267513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1299/2622] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:05.271704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.279014 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c958c94-9b9b-4860-8898-0bb17c0ea1bb None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.283507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bbd35-81d6-4895-8de0-7537a8656b5c None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.283833 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.284718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.285003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.285277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] PATH_INFO: `/v3/projects/ecc72607b1124a3cb94020fafdfde4be` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.286528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc72607b1124a3cb94020fafdfde4be)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.288499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.288618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.289356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.289746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.290151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.291901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:50:05.292549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.294911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.307792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1300/2623] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:50:05.311255 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.321403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cdd8c-6eba-419a-b2fc-b6e192b880b5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.326719 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.327372 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.327653 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.328096 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.328827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.330773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.339391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc72607b1124a3cb94020fafdfde4be', 'request_id': 'req-25d50d61-8c4b-4a79-a110-9adf1efb47a8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.344691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc72607b1124a3cb94020fafdfde4be', 'request_id': 'req-25d50d61-8c4b-4a79-a110-9adf1efb47a8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.353478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc72607b1124a3cb94020fafdfde4be', 'request_id': 'req-25d50d61-8c4b-4a79-a110-9adf1efb47a8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.359850 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1301/2624] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:05.361080 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.364558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] The token cache is being invalidate because project ecc72607b1124a3cb94020fafdfde4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:05.364840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.365489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-25d50d61-8c4b-4a79-a110-9adf1efb47a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.367043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1324/2625] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:05 2022] DELETE /identity/v3/projects/ecc72607b1124a3cb94020fafdfde4be => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:05.371491 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c925-994a-4b74-a74c-547f7dcc822f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.371808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c925-994a-4b74-a74c-547f7dcc822f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.372116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c925-994a-4b74-a74c-547f7dcc822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.389625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c919c925-994a-4b74-a74c-547f7dcc822f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.390974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c919c925-994a-4b74-a74c-547f7dcc822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.421431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f175-8a79-4928-9d61-b2c00919bdaa admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.426151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.426836 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.427119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.427396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.428123 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.430082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.448219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1325/2626] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:05.454461 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1302/2627] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:05.455953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.456090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.456267 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.456522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.457717 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.470018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266bb1-f26f-4c02-8847-60ef483c340d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.474474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.475177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.475659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.475882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.476163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.476438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.477174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.478811 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.483918 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1326/2628] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:05.487902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.489612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1303/2629] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:05.493365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.496684 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ffc8-0b94-4e44-ad2e-79a7603b89b2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.503294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.503477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a074026-06ae-438e-b39d-7ba4c2ed2da5 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.504023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.504298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.504809 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.505554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:50:05.505867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.507489 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.508409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.509045 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.509318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.509589 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.510342 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.511957 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.519548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1327/2630] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:50:05.522512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1304/2631] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:05.523752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.526406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.533265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e3f80-58ad-4bb6-aa5f-00fa3d9d3320 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.536413 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438dfd-db04-45eb-a45b-643e37a2f5bf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.537879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.538524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.538796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.539067 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.539801 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.541174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.542010 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.542401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.542680 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.542950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] PATH_INFO: `/v3/projects/c45ccdee09b64e8982bb196338763401/users/ab43e4353e9f42638e8df0c1b19658cf/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.558031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45ccdee09b64e8982bb196338763401, user_id=ab43e4353e9f42638e8df0c1b19658cf, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.561397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f9bea-64aa-42d0-b6fc-0d7f71a7e477 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.568807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1328/2632] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:05.573097 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.574785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1305/2633] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:05 2022] PUT /identity/v3/projects/c45ccdee09b64e8982bb196338763401/users/ab43e4353e9f42638e8df0c1b19658cf/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:05.586603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.586867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.587151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.613573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] MFA Rules not processed for user `ab43e4353e9f42638e8df0c1b19658cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.614771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.636160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac651-3999-4b8e-900d-fc43e7021252 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.676218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1306/2634] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:05.687451 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.688945 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.694381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.695150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.695549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.696025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.696656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.698665 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.722443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1329/2635] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:05.723492 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.732965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e2c5-bd50-409e-82d8-7ae2121bc35d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.737766 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.738423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.738704 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.739019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.739967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.741335 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.750934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db243066-952f-40a5-8bf3-f21203f4ba65 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.751505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1330/2636] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:05.754749 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.755162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.755403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.755723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.755990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.764558 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbc9d-f045-4cec-8281-023ffd29fe74 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.764731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.766126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.769264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.769909 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.770188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.770459 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.771174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.772770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.775352 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1307/2637] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:50:05.783332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1331/2638] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:05.787532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.794454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.799327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d763-4b1b-4ecc-9f65-4de3c17ad606 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.804104 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0f51-b683-4ed4-adc4-3633bdb45cd0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:05.804302 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.805254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.805636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.806061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] PATH_INFO: `/v3/projects/5a35a8ba332b4594a4088157709bc38d/users/dce7caccde7649ea888e652776285206/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.808828 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:05.809691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.809977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.810252 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] PATH_INFO: `/v3/users/ab43e4353e9f42638e8df0c1b19658cf` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.811454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab43e4353e9f42638e8df0c1b19658cf)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.813406 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.825860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a35a8ba332b4594a4088157709bc38d, user_id=dce7caccde7649ea888e652776285206, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:05.828635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49abe92-5add-467b-876e-220938874cd7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:05.845593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1308/2639] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:05 2022] PUT /identity/v3/projects/5a35a8ba332b4594a4088157709bc38d/users/dce7caccde7649ea888e652776285206/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:05.857619 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.857901 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.858177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.863280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab43e4353e9f42638e8df0c1b19658cf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.875677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab43e4353e9f42638e8df0c1b19658cf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.882432 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab43e4353e9f42638e8df0c1b19658cf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.883128 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab43e4353e9f42638e8df0c1b19658cf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.884084 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] MFA Rules not processed for user `dce7caccde7649ea888e652776285206`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.885292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.891126 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-ebb13513-6e74-402a-a7e3-4b05618e0452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab43e4353e9f42638e8df0c1b19658cf'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:05.898408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1332/2640] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:05 2022] DELETE /identity/v3/users/ab43e4353e9f42638e8df0c1b19658cf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:05.902992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:05.903284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:05.903792 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:05.922764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:05.923991 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.949941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1309/2641] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:05.961071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.962488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:05.980996 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1333/2642] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:05.990747 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:05.992204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.018768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671e1d9-4154-4ead-a1f6-13e22076a7d6 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.048330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a89e8b-0e21-438b-b2b5-816d4cf8067f None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.052353 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.053011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.053289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.053562 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.063034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.064438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.069308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.069975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.070260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.070540 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.073774 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1334/2643] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:50:06.074567 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.075953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.088148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74214f09-5b02-4c30-8718-ccf3e91529b5 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.093336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.094226 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.094509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.094812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] PATH_INFO: `/v3/users/18ba79ecb61c4c9996aa48eeee89429e` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.096051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ba79ecb61c4c9996aa48eeee89429e)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.097980 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.134182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.136393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a416a2-402e-4cfe-9298-da33eae758ad service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.148930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ba79ecb61c4c9996aa48eeee89429e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.151427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1310/2644] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:50:06.164305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ba79ecb61c4c9996aa48eeee89429e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.172060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ba79ecb61c4c9996aa48eeee89429e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.172841 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ba79ecb61c4c9996aa48eeee89429e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.181310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ba79ecb61c4c9996aa48eeee89429e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.188463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1335/2645] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:06 2022] DELETE /identity/v3/users/18ba79ecb61c4c9996aa48eeee89429e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:06.193137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.193496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.193787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.212269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:06.213484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.284422 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1311/2646] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:06.296632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.298070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.362037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.363507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.376333 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7bc6-e858-45c5-ad27-ade60152917f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.378379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983608fb-1bf0-41a7-8090-dbae865ffcf9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.382475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.383575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.384566 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.384852 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.385993 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.386872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.387147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.387416 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] PATH_INFO: `/v3/projects/c45ccdee09b64e8982bb196338763401` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.389357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45ccdee09b64e8982bb196338763401)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.392325 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.400737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.402523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0224b-d1a6-4e24-9fab-be4053036041 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.420616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1336/2647] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:06.460114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45ccdee09b64e8982bb196338763401', 'request_id': 'req-9548939f-8c15-41fe-a43d-5c98a0c6f997'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.466612 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45ccdee09b64e8982bb196338763401', 'request_id': 'req-9548939f-8c15-41fe-a43d-5c98a0c6f997'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.478503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45ccdee09b64e8982bb196338763401', 'request_id': 'req-9548939f-8c15-41fe-a43d-5c98a0c6f997'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.493546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] The token cache is being invalidate because project c45ccdee09b64e8982bb196338763401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:06.493844 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.494679 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-9548939f-8c15-41fe-a43d-5c98a0c6f997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.496779 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1312/2648] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:06 2022] DELETE /identity/v3/projects/c45ccdee09b64e8982bb196338763401 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:06.502307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.502599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.502928 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.522133 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:06.523349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.585045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1337/2649] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:06.592200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.592877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.593226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.613798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:06.615092 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.623973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1313/2650] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:06.628222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.638413 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4ba37-5ef6-470d-819b-9cbd670337ba None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.644121 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.644821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.645099 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.645383 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.646131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:50:06.646434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.648098 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.660858 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1338/2651] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:50:06.665185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.675095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec015-144e-428a-a995-50c2f760b587 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.679931 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.680606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.680887 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.681159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.681873 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.683827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.713716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1314/2652] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:06.715241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.726537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c60e-dfd8-47fb-8df0-a394dd2907ce admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.743024 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.745367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.790859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.791915 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.792203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.792478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.793289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.795812 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.816537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1339/2653] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:06.817953 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeef46-833b-48a9-af10-2f4a4991a1fb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.819783 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.823722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.824234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.824580 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.824939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] PATH_INFO: `/v3/projects/ecb9b62ba1dd4a4f8ec5ca3886b97df3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.826359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb9b62ba1dd4a4f8ec5ca3886b97df3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.828317 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.829957 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca4c3-b9dc-46c1-a467-ab66dd2c1869 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.838616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.838616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.838616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.838616 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.839033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.839033 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.848223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1340/2654] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:06.852023 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.861891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8389-64e9-403e-a5b5-809ef0278893 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.875483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb9b62ba1dd4a4f8ec5ca3886b97df3', 'request_id': 'req-e1080548-eb50-430d-96ed-3909a43373af'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.881018 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb9b62ba1dd4a4f8ec5ca3886b97df3', 'request_id': 'req-e1080548-eb50-430d-96ed-3909a43373af'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.889861 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb9b62ba1dd4a4f8ec5ca3886b97df3', 'request_id': 'req-e1080548-eb50-430d-96ed-3909a43373af'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.901140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] The token cache is being invalidate because project ecb9b62ba1dd4a4f8ec5ca3886b97df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:06.901478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.902134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e1080548-eb50-430d-96ed-3909a43373af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:06.903798 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1315/2655] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:06 2022] DELETE /identity/v3/projects/ecb9b62ba1dd4a4f8ec5ca3886b97df3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:06.908741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6df24-a13a-43ba-be95-14a5d7bad92a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.909025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6df24-a13a-43ba-be95-14a5d7bad92a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.909323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6df24-a13a-43ba-be95-14a5d7bad92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.916019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.917077 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.917358 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.917629 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.918382 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.920032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.928594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-46f6df24-a13a-43ba-be95-14a5d7bad92a None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:06.929642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1341/2656] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:06.929805 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-46f6df24-a13a-43ba-be95-14a5d7bad92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.933685 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.935319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.938170 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1316/2657] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:06.945893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.946181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.946458 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.947174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff216cd-415a-4b1a-9388-59ab5dfda542 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.952030 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:06.952910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.953186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.953457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] PATH_INFO: `/v3/projects/cfa36dc485704c5a89be90cb8719b065/users/5046e574576147bca6fcb1b598eebf1b/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:06.968233 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa36dc485704c5a89be90cb8719b065, user_id=5046e574576147bca6fcb1b598eebf1b, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:06.969132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:06.970427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:06.970879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7c2ba-0322-4d89-beb7-1f72fdd886c1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:06.979297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1317/2658] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:06.983731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:06.986161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1342/2659] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:06 2022] PUT /identity/v3/projects/cfa36dc485704c5a89be90cb8719b065/users/5046e574576147bca6fcb1b598eebf1b/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:06.992542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da3c4c-222b-443b-bd1d-9a4deb74ed6f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:06.996369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:06.996664 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:06.997028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.024415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] MFA Rules not processed for user `5046e574576147bca6fcb1b598eebf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:07.025632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:07.051585 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.052299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.052582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.052862 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.053600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:50:07.053910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.055519 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.070876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1318/2660] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:50:07.072223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.082132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1128b-8a08-4b58-885b-a4a4feb60a36 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.086774 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.087423 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.087720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.088104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.088713 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.089868 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1343/2661] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:07.090563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.101885 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.103367 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:07.120275 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1319/2662] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:07.121289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.163736 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566bd64-528b-4d7d-bdcf-455e7fe24a73 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.186685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7310dc6-0ea9-4db1-be75-62e519f691f7 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.191538 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.192418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.192745 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.192974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.193892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.196124 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.216563 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1320/2663] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:07.216770 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.217330 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.217611 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.217890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.220547 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.230030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3186e-e47c-4972-9635-12bf29b8359f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.234627 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.235284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.235566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.235874 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.236599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.238226 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.250914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1321/2664] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:50:07.252246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.261721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b000-35fa-432e-9bd4-cf64e7d9d807 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.266980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.267633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.267939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.268213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.268930 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.270530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.272866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.274052 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38b0f9-df0f-4ef6-a165-0fb204508b6b service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.281315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1322/2665] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:07.283823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1344/2666] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:50:07.285544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.296147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832430a2-7ee9-452c-b9dd-e265f7fd03bf admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.300988 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.301880 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.302193 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.302466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] PATH_INFO: `/v3/projects/e0fca71d12e64e19897572b70414e273/users/8f1e9ea011274a8aa715245ba9b4d111/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.318177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fca71d12e64e19897572b70414e273, user_id=8f1e9ea011274a8aa715245ba9b4d111, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.320917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.334405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1323/2667] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:07 2022] PUT /identity/v3/projects/e0fca71d12e64e19897572b70414e273/users/8f1e9ea011274a8aa715245ba9b4d111/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:07.345229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.345632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.345981 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.374003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] MFA Rules not processed for user `8f1e9ea011274a8aa715245ba9b4d111`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:07.375185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:07.443239 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1345/2668] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:07.448630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.520100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6690305-9526-4ab4-a1d4-47a676a58716 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.543295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.543936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.544362 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.544965 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.545857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.548037 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.588566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1324/2669] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:07.592900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.606136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83294afe-f704-4d0f-8cc6-630aaaf7a300 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.663640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.664399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.664680 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.665718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.665718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.667989 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.689922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1346/2670] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:50:07.694256 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.705758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34762832-b1e5-443a-bf4f-c753f7f1cc2c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.710751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.711436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.711728 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.712025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.712758 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.714867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.725852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1325/2671] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:07.730051 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.741498 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d3406-e8c2-46b0-bac1-bb51ad10ec7a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.746599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.747709 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.748012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.748292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] PATH_INFO: `/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c/users/15de9d4d27a443949c3825ee047e887c/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.767318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6e0d8f6c4045a5b9706b7c11eaaa4c, user_id=15de9d4d27a443949c3825ee047e887c, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.771804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.791096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1347/2672] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:07 2022] PUT /identity/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c/users/15de9d4d27a443949c3825ee047e887c/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:50:07.797710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.808453 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef70c-acc3-4390-b882-af716c25962f admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.868415 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.869218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.869341 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.869639 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.870441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.872212 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4c695-1493-4ece-a66a-c5ae7da623f9 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.882109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1326/2673] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:07.886848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:07.898028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9ddd-a524-4f5a-855d-422a467def3e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:07.903232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:07.904395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.904671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.904946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] PATH_INFO: `/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c/users/15de9d4d27a443949c3825ee047e887c/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.906978 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6e0d8f6c4045a5b9706b7c11eaaa4c, user_id=15de9d4d27a443949c3825ee047e887c, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:07.909645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:07.920488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1348/2674] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:07 2022] PUT /identity/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c/users/15de9d4d27a443949c3825ee047e887c/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:07.932025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:07.932315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:07.932593 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:07.960484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] MFA Rules not processed for user `15de9d4d27a443949c3825ee047e887c`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:07.961697 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:08.032026 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1327/2675] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:50:08.047122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:08.100582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811d3f9-8281-4f79-9532-7f6d602ea631 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:08.105136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:08.105784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:08.106059 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:08.106332 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:08.161518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:08.162840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3f3f6-4957-4e22-ace9-597a678e17fc service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:08.172345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1349/2676] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:09.792403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:09.794070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:09.865320 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad8e6-9701-4d7a-96c4-b6032d13e98e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:09.870270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:09.871141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:09.871418 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:09.871705 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] PATH_INFO: `/v3/users/dce7caccde7649ea888e652776285206` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:09.872971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce7caccde7649ea888e652776285206)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:09.874911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:09.929582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce7caccde7649ea888e652776285206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:09.942322 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce7caccde7649ea888e652776285206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:09.943033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce7caccde7649ea888e652776285206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:09.943716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce7caccde7649ea888e652776285206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:09.952400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce7caccde7649ea888e652776285206'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:09.965933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1328/2677] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:50:09 2022] DELETE /identity/v3/users/dce7caccde7649ea888e652776285206 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:09.970694 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:09.971202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:09.971321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:09.992086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:09.992086 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:10.055293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1350/2678] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:10.068125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.069879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:10.137942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd62cf-9068-4378-bfde-8fd0fb7c10c3 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.142827 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.143491 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.143795 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.144070 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.154615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.156117 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecceeb-eb2c-4c88-9495-1b80c0f60342 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.167187 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1329/2679] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:10.457113 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.458688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:10.472958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b32e3-3526-40e0-b6f4-eec4dfa471b7 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.478443 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.479323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.479762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.479865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] PATH_INFO: `/v3/projects/5a35a8ba332b4594a4088157709bc38d` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.481293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a35a8ba332b4594a4088157709bc38d)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.483393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.530418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a35a8ba332b4594a4088157709bc38d', 'request_id': 'req-9f4bb717-b78b-4cc8-a498-ed68867323ff'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:10.536000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a35a8ba332b4594a4088157709bc38d', 'request_id': 'req-9f4bb717-b78b-4cc8-a498-ed68867323ff'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:10.547603 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a35a8ba332b4594a4088157709bc38d', 'request_id': 'req-9f4bb717-b78b-4cc8-a498-ed68867323ff'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:10.558821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] The token cache is being invalidate because project 5a35a8ba332b4594a4088157709bc38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:10.559108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:10.559814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-9f4bb717-b78b-4cc8-a498-ed68867323ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:10.561386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1351/2680] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:50:10 2022] DELETE /identity/v3/projects/5a35a8ba332b4594a4088157709bc38d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:10.566326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.566610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.566888 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.584535 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:10.585723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:10.650116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1330/2681] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:10.659246 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.659751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.660238 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.688082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:10.689255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:10.698205 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1352/2682] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:10.702773 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.713038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be320b-55ee-4ba1-a851-f77e6fd56f6d None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.719803 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.720494 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.720776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.721021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.721761 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:50:10.722069 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.723730 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.736232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1331/2683] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:50:10.740763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.750537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb997b4b-e90c-4be4-9115-996b9169fa12 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.756525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.757191 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.757475 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.757751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.758451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.760430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.790236 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1353/2684] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:50:10 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:10.794902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.804923 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333606d-2b3d-4fec-811e-c5ea4680c415 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.864412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.865108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.865388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.865714 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.866475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.868473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.890488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1332/2685] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:50:10 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:50:10.894740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.905731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b93c66-f197-431e-93e5-e766bff87355 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.914343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.915349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.915757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.916105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.917552 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.920830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.937423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1354/2686] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:10.941671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.953012 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1405e-b2e9-4887-90eb-9a1c87fd1001 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.958626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.959298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.959577 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.959885 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:10.960623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:10.962268 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328cb74-9df0-4e1c-9389-743659cbf597 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:10.972799 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1333/2687] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:50:10.976906 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:10.987197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898423-c630-4e45-908c-1a68401e6e71 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:10.992387 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:10.993343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:10.993622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:10.993902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] PATH_INFO: `/v3/projects/483242f54cee494488412212b4b4148f/users/7920859b201840679893dd80cdceef2a/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:11.010842 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483242f54cee494488412212b4b4148f, user_id=7920859b201840679893dd80cdceef2a, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:11.013798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:11.031418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1355/2688] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:50:10 2022] PUT /identity/v3/projects/483242f54cee494488412212b4b4148f/users/7920859b201840679893dd80cdceef2a/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:11.043221 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:11.043517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:11.043909 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:11.073378 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] MFA Rules not processed for user `7920859b201840679893dd80cdceef2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:11.074785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:11.155064 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1334/2689] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:11.168657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:11.170682 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:11.229986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fce842-8507-4880-8ba7-0798f0b187b5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:11.234045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:11.234692 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:11.234971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:11.235264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:11.243796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:11.245221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:11.254447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1356/2690] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:20.016133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:20.017755 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:20.085230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108a8d-13c2-4645-ae5d-fc4a4cf838ab None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:20.089927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:20.090610 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:20.090893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:20.091168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:20.093274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:20.158767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:20.160273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97566f-ca90-4d7c-b616-6b12fab3c64e service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:20.171062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1335/2691] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:08.955321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:08.957102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.024671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6098160-b3a4-43df-a59c-13eb50a93260 service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:09.031754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:09.032643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.032919 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.033187 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] PATH_INFO: `/v3/users/5046e574576147bca6fcb1b598eebf1b` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.034494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5046e574576147bca6fcb1b598eebf1b)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:09.036472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:09.092345 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5046e574576147bca6fcb1b598eebf1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.103985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5046e574576147bca6fcb1b598eebf1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.111575 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5046e574576147bca6fcb1b598eebf1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.112376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5046e574576147bca6fcb1b598eebf1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.123716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5046e574576147bca6fcb1b598eebf1b'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.130193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1357/2692] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:08 2022] DELETE /identity/v3/users/5046e574576147bca6fcb1b598eebf1b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:09.135473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.136005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.136109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.153566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:09.154767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.216936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1336/2693] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:09.228308 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:09.230148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.290820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c522-631d-4881-9dbc-7c2021636723 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:09.295946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:09.296600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.296882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.297151 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.307554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:09.309082 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931a635-d65a-411b-9f9a-0862baf41d63 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:09.319109 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1358/2694] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:09.597235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:09.599484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.623606 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492a5c-1327-49d4-a025-6119a4017863 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:09.636457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:09.638464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.638941 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.639521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] PATH_INFO: `/v3/projects/cfa36dc485704c5a89be90cb8719b065` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.641939 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa36dc485704c5a89be90cb8719b065)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:09.651550 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:09.708948 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa36dc485704c5a89be90cb8719b065', 'request_id': 'req-13d243e9-886d-4a92-a395-3efb66b5341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.714303 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa36dc485704c5a89be90cb8719b065', 'request_id': 'req-13d243e9-886d-4a92-a395-3efb66b5341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.722958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa36dc485704c5a89be90cb8719b065', 'request_id': 'req-13d243e9-886d-4a92-a395-3efb66b5341e'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.734038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] The token cache is being invalidate because project cfa36dc485704c5a89be90cb8719b065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:09.734327 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.734954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-13d243e9-886d-4a92-a395-3efb66b5341e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:09.736595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1337/2695] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:09 2022] DELETE /identity/v3/projects/cfa36dc485704c5a89be90cb8719b065 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:09.742150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.742445 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.742798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.764185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:09.765470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.831140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1359/2696] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:09.897924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.898204 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.898502 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.920511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:09.921746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:09.930088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1338/2697] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:09.934537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:09.944925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbad83-e14a-48c3-ba97-3c24267e0850 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:09.950658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:09.951331 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.951610 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.951912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.952732 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:09.953036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:09.954637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:09.966409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1360/2698] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:51:09.970778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:09.980787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff685bf-4e55-40ff-befc-9c6e3a3a56f4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:09.986334 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:09.987044 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:09.987329 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:09.987615 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:09.988349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:09.990473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.018431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1339/2699] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:09 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:10.022645 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.032757 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacd06-cc3c-4da7-ad1b-d943095d765a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.093490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.094175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.094456 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.094720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.095464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.097429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.120134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1361/2700] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:10.125450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.136282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4853930-bdc6-4457-b921-eb2b53208521 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.142297 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.142969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.143274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.143544 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.144316 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.145935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.158299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1340/2701] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:10.162338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.173939 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85394db5-02bb-40ba-b7d2-622ac7221e8a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.178660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.179346 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.179638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.179942 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.180672 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.182277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da96241-8202-404c-a5ab-26cfd6f6969c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.193116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1362/2702] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:10.197541 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.208625 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ef8f-fbac-4536-98f9-fb48a8c08d44 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.214687 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.215582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.216067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.216344 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] PATH_INFO: `/v3/projects/08b36457885d4daa8ecad3525b981c48/users/697769f55e434dd8bba9523fa01038b8/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.232900 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b36457885d4daa8ecad3525b981c48, user_id=697769f55e434dd8bba9523fa01038b8, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.235497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.255343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1341/2703] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:10 2022] PUT /identity/v3/projects/08b36457885d4daa8ecad3525b981c48/users/697769f55e434dd8bba9523fa01038b8/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:10.268834 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.269129 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.269411 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.296523 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] MFA Rules not processed for user `697769f55e434dd8bba9523fa01038b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:10.297910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:10.362655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1363/2704] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:10.367308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.433061 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8561ea-06d9-4eef-aee5-1a6d2ba02d30 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.440022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.440022 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.440324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.440600 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.441447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.443409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.475641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1342/2705] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:10.481460 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.497985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cbfc3-b90a-4c0e-9d15-8bc8091678ff None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.554551 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.555240 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.555518 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.555813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.556544 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.558490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.581691 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1364/2706] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:10.585809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.596447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676551ab-45bd-483e-aa73-90f95d253585 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.601161 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.601833 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.602116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.602432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.603167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.604792 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.615109 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1343/2707] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:10.619194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.629701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316197a-0110-4b9f-92dc-f0a12384626a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.634563 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.635224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.635504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.635808 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.636538 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.638131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a006-2275-4f31-8473-439ccb10cd82 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.648271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1365/2708] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:10.652604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.663181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d83b22-156e-49df-8ab9-88ef856a9894 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.669479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.670592 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.671057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.671349 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] PATH_INFO: `/v3/projects/1265b9088e864898ad49d2b22d9f51bb/users/9f93446f141846f3ada938533320187f/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.687050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1265b9088e864898ad49d2b22d9f51bb, user_id=9f93446f141846f3ada938533320187f, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.689744 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.705581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1344/2709] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:10 2022] PUT /identity/v3/projects/1265b9088e864898ad49d2b22d9f51bb/users/9f93446f141846f3ada938533320187f/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:10.718522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.718813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.719090 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.747582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] MFA Rules not processed for user `9f93446f141846f3ada938533320187f`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:10.749190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:10.816048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1366/2710] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:10.820989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.883528 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f6a89-7a5f-43ab-b1a8-5a0855099e8b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.888249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.889051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.889553 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.889852 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.890552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:10.892512 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:10.922611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1345/2711] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:10.925994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:10.937028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5d18-bcee-4d0c-bc27-ea8d7a95a607 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:10.997532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:10.998361 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:10.998733 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:10.999047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:10.999950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.001796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.025715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1367/2712] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:10 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:11.026906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:11.038583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1817-950a-4ac7-a7ee-4cb19168365d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:11.044404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:11.045462 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.046213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.046497 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.047246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.048879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.060398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1346/2713] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:11.065194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:11.075482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b425-5e6b-4fd7-9053-81a2d5bad3bd admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:11.080707 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:11.081595 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.081873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.082142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] PATH_INFO: `/v3/projects/e831bdf1f8ed4d7391458e1323be4e67/users/8849ea13a9af4a52a500472779800e78/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.097401 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e831bdf1f8ed4d7391458e1323be4e67, user_id=8849ea13a9af4a52a500472779800e78, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.100127 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.114543 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1368/2714] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:11 2022] PUT /identity/v3/projects/e831bdf1f8ed4d7391458e1323be4e67/users/8849ea13a9af4a52a500472779800e78/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:11.118896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:11.130100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97380-3afb-4fbe-b585-6eef918d48b2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:11.196893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:11.197649 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.197947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.198215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.198975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.200611 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26200-8a09-4b86-81f7-ff1cdedd9dda admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.210630 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1347/2715] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:11.214900 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:11.225532 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616133f-491f-4687-b7f4-3885e2c3869b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:11.230421 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:11.231314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.231614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.231912 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] PATH_INFO: `/v3/projects/e831bdf1f8ed4d7391458e1323be4e67/users/8849ea13a9af4a52a500472779800e78/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.234105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e831bdf1f8ed4d7391458e1323be4e67, user_id=8849ea13a9af4a52a500472779800e78, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.236790 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.247061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1369/2716] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:11 2022] PUT /identity/v3/projects/e831bdf1f8ed4d7391458e1323be4e67/users/8849ea13a9af4a52a500472779800e78/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:11.258031 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.258254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.258588 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.287136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] MFA Rules not processed for user `8849ea13a9af4a52a500472779800e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:11.288433 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:11.368407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1348/2717] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:11.380598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:11.382357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:11.446930 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7d42-7182-43ff-9889-fc741a2c0201 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:11.451381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:11.452110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:11.452470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:11.452744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:11.515598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:11.517092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb51831-2a19-4d30-b5d8-8c72dd9f773a service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:11.526632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1370/2718] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:12.101464 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:12.103141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:12.176147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caba77d-028a-4e5c-a88f-74aedf6dbdb5 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:12.182668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:12.183552 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:12.183860 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:12.184146 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] PATH_INFO: `/v3/users/8f1e9ea011274a8aa715245ba9b4d111` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:12.185400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1e9ea011274a8aa715245ba9b4d111)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:12.187527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:12.236118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1e9ea011274a8aa715245ba9b4d111'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.247668 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1e9ea011274a8aa715245ba9b4d111'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.248382 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1e9ea011274a8aa715245ba9b4d111'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.249011 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1e9ea011274a8aa715245ba9b4d111'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.259298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1e9ea011274a8aa715245ba9b4d111'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.272048 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1349/2719] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:12 2022] DELETE /identity/v3/users/8f1e9ea011274a8aa715245ba9b4d111 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:12.276697 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:12.277206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:12.277206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:12.294796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:12.296031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:12.360731 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1371/2720] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:12.371176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:12.373543 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:12.444021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f50ab3-5e78-4649-9b87-cf673415c8c1 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:12.449144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:12.450286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:12.450789 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:12.451299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:12.467998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:12.469467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:12.479595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1350/2721] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:12.764816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:12.766482 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:12.779853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc2ea9-17e2-4db9-b42c-4078e4809f70 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:12.785202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:12.786987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:12.787291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:12.788593 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] PATH_INFO: `/v3/projects/e0fca71d12e64e19897572b70414e273` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:12.789896 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fca71d12e64e19897572b70414e273)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:12.792203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:12.840142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fca71d12e64e19897572b70414e273', 'request_id': 'req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.846295 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fca71d12e64e19897572b70414e273', 'request_id': 'req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.854748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fca71d12e64e19897572b70414e273', 'request_id': 'req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.866142 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] The token cache is being invalidate because project e0fca71d12e64e19897572b70414e273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:12.866430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.867068 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:12.868656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1372/2722] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:12 2022] DELETE /identity/v3/projects/e0fca71d12e64e19897572b70414e273 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:12.872809 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:12.884562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763841db-d969-47a5-a683-1c4459aa8c0f service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:12.947284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:12.948241 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:12.948527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:12.948804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] PATH_INFO: `/v3/users/15de9d4d27a443949c3825ee047e887c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:12.950015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15de9d4d27a443949c3825ee047e887c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:12.951976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.009980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15de9d4d27a443949c3825ee047e887c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.027998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15de9d4d27a443949c3825ee047e887c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.028808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15de9d4d27a443949c3825ee047e887c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.029487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15de9d4d27a443949c3825ee047e887c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.038400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15de9d4d27a443949c3825ee047e887c'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.054896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1351/2723] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:12 2022] DELETE /identity/v3/users/15de9d4d27a443949c3825ee047e887c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:13.056002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.057625 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.117740 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8bd2-40ab-4b7b-99d6-29b970bacc7f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.167399 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.168110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.168395 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.168741 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.171224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.232728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.234279 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e462-38b6-425c-a583-ac5b1507b46f service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.243637 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1373/2724] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:13.332703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.334196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.411613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30c70-a4eb-4fb0-9fd3-62542a3b0206 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.417168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.418156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.418442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.418716 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] PATH_INFO: `/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.419972 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6e0d8f6c4045a5b9706b7c11eaaa4c)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.422083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.468989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6e0d8f6c4045a5b9706b7c11eaaa4c', 'request_id': 'req-8d0ddcab-36f7-44b9-87db-a29130329e9a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.475291 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6e0d8f6c4045a5b9706b7c11eaaa4c', 'request_id': 'req-8d0ddcab-36f7-44b9-87db-a29130329e9a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.484082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6e0d8f6c4045a5b9706b7c11eaaa4c', 'request_id': 'req-8d0ddcab-36f7-44b9-87db-a29130329e9a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.496450 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] The token cache is being invalidate because project 9f6e0d8f6c4045a5b9706b7c11eaaa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:13.496732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.497360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-8d0ddcab-36f7-44b9-87db-a29130329e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:13.498892 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1352/2725] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:13 2022] DELETE /identity/v3/projects/9f6e0d8f6c4045a5b9706b7c11eaaa4c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:13.504194 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.504671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.504798 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.521982 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:13.523169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.585053 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1374/2726] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:13.594562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.594864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.595151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.613513 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:13.614706 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.623093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1353/2727] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:13.627816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.638560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4fcd3-0ad1-47eb-a8f3-68f2cc083fb3 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.644372 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.645080 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.645368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.645671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.646410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:13.646722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.648381 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.660508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1375/2728] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:51:13.665475 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.675236 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db45a1-9d8c-43ad-93a2-d2bc3f773479 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.680937 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.681642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.681921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.682196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.682896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.685020 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.712980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1354/2729] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:13 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:13.717199 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.726925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5c358-453e-4d00-a52c-5879ec70642e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.782060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.782750 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.783015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.783290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.784034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.785946 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.802853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.804664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.809802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1376/2730] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:13 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:13.814070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.826081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863315c-170f-4669-b8f2-9f5846916a5b admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.831018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.831746 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.832036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.832309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.833046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.835799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.850838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1377/2731] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:51:13.853388 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.863587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f5bf-d309-4d65-9bd6-17631929540a admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.863998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e029c7-df48-49a4-8404-a57d555f3174 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.867759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.868231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.868359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.868603 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.868877 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.868977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.869155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.869430 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.870152 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.870648 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:13.871843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.882776 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1378/2732] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:51:13.886717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:13.896135 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0f7e-73f6-4c97-ab7e-4a979ea72701 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:13.900607 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:13.901506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.901782 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.902055 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] PATH_INFO: `/v3/projects/2996bb1964b34f9394202ec5390f7075/users/4fa8fc2788d347efae5c2ac933f842b9/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.917961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2996bb1964b34f9394202ec5390f7075, user_id=4fa8fc2788d347efae5c2ac933f842b9, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.920627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dd3a9-14fb-450e-9895-6110d3d112bb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.933986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1379/2733] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:13 2022] PUT /identity/v3/projects/2996bb1964b34f9394202ec5390f7075/users/4fa8fc2788d347efae5c2ac933f842b9/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:13.935898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:13.936295 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:13.945627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:13.945913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:13.946060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1355/2734] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:13.946264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:13.972321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] MFA Rules not processed for user `4fa8fc2788d347efae5c2ac933f842b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:13.973528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.042571 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.044108 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.056487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1380/2735] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:14.056487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.058556 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810878d7-d701-4702-9466-f70bb9ba0850 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.109118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576a04-128c-40fb-9757-0193bafcf54e None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.113656 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.114305 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.114452 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.114569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.114843 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.115196 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.115501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.115614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.115814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] PATH_INFO: `/v3/users/7920859b201840679893dd80cdceef2a` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.117029 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7920859b201840679893dd80cdceef2a)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.117506 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.118934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.148660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1381/2736] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:14.149602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.163942 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7920859b201840679893dd80cdceef2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.176436 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7920859b201840679893dd80cdceef2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.177127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7920859b201840679893dd80cdceef2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.177739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7920859b201840679893dd80cdceef2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.187893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-76ff5184-a4d8-44c7-93ad-0e24ee1b1511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7920859b201840679893dd80cdceef2a'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.200586 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1356/2737] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:14 2022] DELETE /identity/v3/users/7920859b201840679893dd80cdceef2a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:14.205009 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.205301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.205584 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.211748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b655a-c9e8-497a-9e41-2799d1780859 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.223398 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:14.224853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.268549 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.269343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.269622 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.269895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.270648 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.272617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.284840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1357/2738] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:14.293519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1382/2739] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:14.297596 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.298531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.298973 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.300296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.311738 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cca6d-de94-4fab-8b1c-51a8ca4ac27b None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.317914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.318709 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.318995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.319457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.320455 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.322076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.335503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1358/2740] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:14.336504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.346290 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597b04-8a33-46f3-a4b9-03c4b4acf228 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.351816 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.352770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.353050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.353324 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] PATH_INFO: `/v3/projects/9b3b78cd130348928b54c4a789884bac/users/6e24b317ba1d4dffba3c79c262e32690/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.361131 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76e57-aa98-4d46-8da8-81e068c0f69e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.365315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.366141 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.366507 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.366826 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.370071 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3b78cd130348928b54c4a789884bac, user_id=6e24b317ba1d4dffba3c79c262e32690, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.372786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.377223 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.378666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.387838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1359/2741] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:14 2022] PUT /identity/v3/projects/9b3b78cd130348928b54c4a789884bac/users/6e24b317ba1d4dffba3c79c262e32690/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:14.388504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1383/2742] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:51:14.393134 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.459318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e409b-a5a7-46b3-86b2-901695d359fc admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.464616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.465315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.465609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.465907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.466650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.468354 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956dc2-53ac-46c6-9cdf-8a9892b12325 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.478514 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1360/2743] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:14.484652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.495899 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5acda-7ec7-4f12-9378-5f71640f92f3 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.501004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.501727 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.502011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.502290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] PATH_INFO: `/v3/projects/9b3b78cd130348928b54c4a789884bac/users/6e24b317ba1d4dffba3c79c262e32690/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.504309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3b78cd130348928b54c4a789884bac, user_id=6e24b317ba1d4dffba3c79c262e32690, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.506968 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.517644 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1384/2744] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:14 2022] PUT /identity/v3/projects/9b3b78cd130348928b54c4a789884bac/users/6e24b317ba1d4dffba3c79c262e32690/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:14.527997 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.528299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.528614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.556994 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] MFA Rules not processed for user `6e24b317ba1d4dffba3c79c262e32690`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:14.558211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.625722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1361/2745] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:14.636418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.638178 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.666591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.668391 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.700255 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51769b-11ad-40f8-9d4d-71c65f868e4f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.704216 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.704955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.705304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.705676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.715829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.717314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.727366 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1385/2746] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:14.736119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4821f-4965-4c19-aa5d-698cdbf8b7c3 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.740839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.741718 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.742004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.742282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] PATH_INFO: `/v3/projects/483242f54cee494488412212b4b4148f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.743503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483242f54cee494488412212b4b4148f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.745468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.774042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.775955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.787677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dff68-501a-4065-8b7b-6cf60d9de0ea service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.794581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483242f54cee494488412212b4b4148f', 'request_id': 'req-2788d435-5b4d-4d40-ba78-7a8ff40cada5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.800452 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483242f54cee494488412212b4b4148f', 'request_id': 'req-2788d435-5b4d-4d40-ba78-7a8ff40cada5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.809771 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483242f54cee494488412212b4b4148f', 'request_id': 'req-2788d435-5b4d-4d40-ba78-7a8ff40cada5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.822739 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] The token cache is being invalidate because project 483242f54cee494488412212b4b4148f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:14.823005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.823695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2788d435-5b4d-4d40-ba78-7a8ff40cada5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:14.825293 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1362/2747] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:14 2022] DELETE /identity/v3/projects/483242f54cee494488412212b4b4148f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:14.830566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db22b-6f87-46eb-9308-1e533c62ed6f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.830863 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db22b-6f87-46eb-9308-1e533c62ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.831140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db22b-6f87-46eb-9308-1e533c62ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.841012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.841679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.841962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.842237 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.844412 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.852904 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-fb8db22b-6f87-46eb-9308-1e533c62ed6f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:14.854078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fb8db22b-6f87-46eb-9308-1e533c62ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.902499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.903881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.913043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1363/2749] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:14.913189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1386/2749] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:14.921174 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.921478 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.921951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.940038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:14.941238 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:14.949292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1364/2750] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:14.953636 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:14.965072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627739f-3424-4d69-b9e6-23f14cad2495 service cinder] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:14.970292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:14.970961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:14.971249 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:14.971524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:14.972290 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:14.972598 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:14.974209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:14.987744 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1387/2751] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:51:14.990936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.001136 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631e86-c0a7-4ac2-a417-121d670cd35f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.005961 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.006650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.006933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.007207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.007951 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.009867 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.037524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1365/2752] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:14 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:15.042796 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.053254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3fe20-8ba5-4cb4-ae04-6dec46efda91 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.119526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.120470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.120745 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.121019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.121728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.123763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.146816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1388/2753] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:15 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:15.151267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.171785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49deb4-f237-496a-b78b-7867961acc02 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.177457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.177989 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.178273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.178548 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.179315 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.180924 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.192980 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1366/2754] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:15.197124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.208115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8856c48-5a69-4905-a491-02461064bb3c admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.213123 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.213822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.214092 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.214378 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.215110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.216913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011f004-19fe-47ba-a2eb-2489927cb1a0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.239594 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.240011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1389/2755] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:15.251300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af70a8-5b66-431d-b7dc-da6964b02a02 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.258404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.259301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.259644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.260104 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] PATH_INFO: `/v3/projects/bfde9adfbfb34784b01e71d2b9b683f3/users/236c87ac79b84605919a7f75c75e43fc/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.276079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfde9adfbfb34784b01e71d2b9b683f3, user_id=236c87ac79b84605919a7f75c75e43fc, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.279120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.292672 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1367/2756] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:15 2022] PUT /identity/v3/projects/bfde9adfbfb34784b01e71d2b9b683f3/users/236c87ac79b84605919a7f75c75e43fc/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:15.303853 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.304149 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.304451 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.334547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] MFA Rules not processed for user `236c87ac79b84605919a7f75c75e43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:15.335916 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:15.405882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1390/2757] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:15.418259 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:15.420047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:15.477087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec743b9-35db-4dd3-b0e6-aaa0f718f7bb admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:15.481062 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:15.481722 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:15.482007 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:15.482286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:15.491658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:15.493137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be5ee-5572-4139-a77e-c9cc32ad33f0 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:15.503177 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1368/2758] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:18.221083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:18.221083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.288314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113a0a-e063-4c0d-9ad4-f7d757460a38 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:18.293596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:18.294480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:18.294762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:18.295122 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] PATH_INFO: `/v3/users/4fa8fc2788d347efae5c2ac933f842b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:18.296415 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa8fc2788d347efae5c2ac933f842b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:18.298418 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:18.347447 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa8fc2788d347efae5c2ac933f842b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.361201 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa8fc2788d347efae5c2ac933f842b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.368217 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa8fc2788d347efae5c2ac933f842b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.368923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa8fc2788d347efae5c2ac933f842b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.377954 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa8fc2788d347efae5c2ac933f842b9'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.383990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1391/2759] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:18 2022] DELETE /identity/v3/users/4fa8fc2788d347efae5c2ac933f842b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:18.388651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:18.389127 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:18.389240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:18.407359 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:18.408662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.480111 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1369/2760] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:18.490164 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:18.491701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.553963 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011435b8-9074-4f95-af5a-27f56f9650cc admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:18.558096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:18.558755 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:18.559026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:18.559311 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:18.569036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:18.570477 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:18.579998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1392/2761] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:18.864492 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:18.866091 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.878712 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32828e-e374-4c2b-a0c5-f806a25a8885 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:18.884920 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:18.885689 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:18.885964 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:18.886280 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] PATH_INFO: `/v3/projects/2996bb1964b34f9394202ec5390f7075` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:18.887546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2996bb1964b34f9394202ec5390f7075)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:18.889664 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:18.911485 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:18.913036 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.926657 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ba844-b0d3-4c51-b06f-347dcf6be443 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:18.931653 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:18.932588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:18.932867 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:18.933140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] PATH_INFO: `/v3/users/697769f55e434dd8bba9523fa01038b8` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:18.934319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697769f55e434dd8bba9523fa01038b8)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:18.936467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:18.940834 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2996bb1964b34f9394202ec5390f7075', 'request_id': 'req-fccd944c-fb68-469a-a320-e2a39c39db77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.946247 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2996bb1964b34f9394202ec5390f7075', 'request_id': 'req-fccd944c-fb68-469a-a320-e2a39c39db77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.955483 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2996bb1964b34f9394202ec5390f7075', 'request_id': 'req-fccd944c-fb68-469a-a320-e2a39c39db77'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.966669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] The token cache is being invalidate because project 2996bb1964b34f9394202ec5390f7075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:18.966960 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.967595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.969163 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1370/2762] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:18 2022] DELETE /identity/v3/projects/2996bb1964b34f9394202ec5390f7075 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:18.973220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:18.974599 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:18.984884 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697769f55e434dd8bba9523fa01038b8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:18.996515 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697769f55e434dd8bba9523fa01038b8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.003317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697769f55e434dd8bba9523fa01038b8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.004048 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697769f55e434dd8bba9523fa01038b8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.012821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-942e7388-cbca-4bfb-9497-8efc763f2272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697769f55e434dd8bba9523fa01038b8'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.018859 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1393/2763] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:18 2022] DELETE /identity/v3/users/697769f55e434dd8bba9523fa01038b8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:19.023188 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.023474 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.023788 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.046659 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd944c-fb68-469a-a320-e2a39c39db77 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.047429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:19.048765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.102472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.103361 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.103642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.103949 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] PATH_INFO: `/v3/users/6e24b317ba1d4dffba3c79c262e32690` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.105141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e24b317ba1d4dffba3c79c262e32690)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.107138 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.109807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1394/2764] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:19.119802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.121168 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.155356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e24b317ba1d4dffba3c79c262e32690'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.167866 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e24b317ba1d4dffba3c79c262e32690'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.168565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e24b317ba1d4dffba3c79c262e32690'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.169192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e24b317ba1d4dffba3c79c262e32690'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.179324 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d834-0d5e-4e6f-b4f6-98befaf43eed None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.179569 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e24b317ba1d4dffba3c79c262e32690'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.183012 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.183669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.183983 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.184258 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.186047 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.192176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1371/2765] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:18 2022] DELETE /identity/v3/users/6e24b317ba1d4dffba3c79c262e32690 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:19.198883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.200463 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.210380 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1395/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:51:19.542554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.544810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.573739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.576208 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.589751 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac5044-2987-451b-b74f-ec2983ff2270 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.617387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519be8-bfb7-4e2a-9803-14857eeafb71 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.622137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.622954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.623237 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.623515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] PATH_INFO: `/v3/projects/9b3b78cd130348928b54c4a789884bac` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.624741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3b78cd130348928b54c4a789884bac)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.627488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.651268 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.652320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.652602 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.652879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] PATH_INFO: `/v3/projects/08b36457885d4daa8ecad3525b981c48` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.654117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b36457885d4daa8ecad3525b981c48)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.656306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.675896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3b78cd130348928b54c4a789884bac', 'request_id': 'req-a73a9a52-7398-4819-aed2-a799529094ab'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.681804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3b78cd130348928b54c4a789884bac', 'request_id': 'req-a73a9a52-7398-4819-aed2-a799529094ab'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.690321 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3b78cd130348928b54c4a789884bac', 'request_id': 'req-a73a9a52-7398-4819-aed2-a799529094ab'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.701913 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] The token cache is being invalidate because project 9b3b78cd130348928b54c4a789884bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:19.702217 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.702927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-a73a9a52-7398-4819-aed2-a799529094ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.704322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b36457885d4daa8ecad3525b981c48', 'request_id': 'req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.704522 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1372/2767] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:19 2022] DELETE /identity/v3/projects/9b3b78cd130348928b54c4a789884bac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:19.710144 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b36457885d4daa8ecad3525b981c48', 'request_id': 'req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.710479 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706579-6bb4-4be2-b917-64350ec76b6e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.710845 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706579-6bb4-4be2-b917-64350ec76b6e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.711168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706579-6bb4-4be2-b917-64350ec76b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.718522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b36457885d4daa8ecad3525b981c48', 'request_id': 'req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.729846 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] The token cache is being invalidate because project 08b36457885d4daa8ecad3525b981c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:19.730143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.730836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.730974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-3d706579-6bb4-4be2-b917-64350ec76b6e None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:19.732179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3d706579-6bb4-4be2-b917-64350ec76b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.732676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1396/2768] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:19 2022] DELETE /identity/v3/projects/08b36457885d4daa8ecad3525b981c48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:19.736807 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.738154 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.790741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1373/2769] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:19.799434 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.799757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.799882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e63b7-9cac-4d12-ab7a-ad00166990c2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.800043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.804410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.805293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.805564 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.805830 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] PATH_INFO: `/v3/users/9f93446f141846f3ada938533320187f` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.807006 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f93446f141846f3ada938533320187f)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.809001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.819137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:19.820557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.829192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1374/2770] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:19.833504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.842879 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9b37-573e-43f1-a9a2-0a11a19f0819 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.848421 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.849052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.849337 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.849613 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.850367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:19.850684 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.852546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.863661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f93446f141846f3ada938533320187f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.864984 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1375/2771] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:51:19.869410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.878274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f93446f141846f3ada938533320187f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.879723 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4ddd3-7e2b-40d4-8bab-f75baef12032 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:19.885245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f93446f141846f3ada938533320187f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.885390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:19.886006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:19.886125 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f93446f141846f3ada938533320187f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.886282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:19.886562 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:19.887258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:19.889270 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:19.894910 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f93446f141846f3ada938533320187f'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:19.901165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1397/2772] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:19 2022] DELETE /identity/v3/users/9f93446f141846f3ada938533320187f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:19.921975 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1376/2773] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:19 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:19.923112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:19.924887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:19.991232 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692e21-d748-4241-838a-67d39bc7e5db admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.048061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.049186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.049531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.049701 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.050429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.052398 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.078265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1398/2774] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:19 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:20.079875 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.090294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7bfe-0999-4ced-885e-c6c038bfbd17 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.095088 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.096068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.096355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.096633 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.097379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.098983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.109602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1377/2775] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:20.113773 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.123791 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1db44-70d0-47d6-afe7-5f8229c12a8f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.129286 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.129895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.130174 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.130444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.131171 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.132803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.142922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1399/2776] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:20.147168 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.157601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006943-c24f-4146-b430-6eb244de2d75 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.162644 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.163642 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.163976 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.164232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] PATH_INFO: `/v3/projects/dc8592d81bee47f79889df59452c7abb/users/f09a1dd7ea434ab8b01d946bf3ff4b24/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.175522 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.177469 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.180521 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8592d81bee47f79889df59452c7abb, user_id=f09a1dd7ea434ab8b01d946bf3ff4b24, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.185990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50eba-465d-4eae-beef-fbbb9580d2d7 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.190632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765333a7-553d-4010-b39c-1cea922f1f0f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.195838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.196748 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.197007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.197273 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] PATH_INFO: `/v3/projects/1265b9088e864898ad49d2b22d9f51bb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.198470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1265b9088e864898ad49d2b22d9f51bb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.200638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.203782 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1378/2777] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:20 2022] PUT /identity/v3/projects/dc8592d81bee47f79889df59452c7abb/users/f09a1dd7ea434ab8b01d946bf3ff4b24/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:20.215253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.215542 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.215853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.245636 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] MFA Rules not processed for user `f09a1dd7ea434ab8b01d946bf3ff4b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:20.246856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.260514 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1265b9088e864898ad49d2b22d9f51bb', 'request_id': 'req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.276264 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1265b9088e864898ad49d2b22d9f51bb', 'request_id': 'req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.285470 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1265b9088e864898ad49d2b22d9f51bb', 'request_id': 'req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.297976 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] The token cache is being invalidate because project 1265b9088e864898ad49d2b22d9f51bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:20.298323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.299163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.300871 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1400/2778] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:20 2022] DELETE /identity/v3/projects/1265b9088e864898ad49d2b22d9f51bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:20.304764 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.306064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.318601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1379/2779] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:20.323286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.324746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.368819 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8bad8-957f-4f9b-8bbc-d2a6d958dd64 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.373576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.374490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.374763 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.375000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] PATH_INFO: `/v3/users/8849ea13a9af4a52a500472779800e78` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.376679 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8849ea13a9af4a52a500472779800e78)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.378643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.388394 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb6d5f-2ed0-4424-81fb-721ac6b78233 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.393068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.393828 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.394107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.394379 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.395095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.397025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.425278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1380/2780] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:20 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:20.427640 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8849ea13a9af4a52a500472779800e78'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.429390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.438869 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8849ea13a9af4a52a500472779800e78'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.445749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8849ea13a9af4a52a500472779800e78'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.446525 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8849ea13a9af4a52a500472779800e78'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.456242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8849ea13a9af4a52a500472779800e78'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.463559 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1401/2781] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:20 2022] DELETE /identity/v3/users/8849ea13a9af4a52a500472779800e78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:20.498079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd4e-980e-4325-abd3-69395d957581 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.554903 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.555675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.556021 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.556300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.556995 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.559251 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.579393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1381/2782] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:20 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:51:20.583531 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.585157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.598221 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620344f7-a62b-4582-abb5-a305d333ab38 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.603192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.603940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.604215 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.604508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.605248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.607024 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.618605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1402/2783] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:20.622907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.633447 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310db24-60da-4a6e-a33f-4005e4f99ea2 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.638895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.639794 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.640052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.640346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] PATH_INFO: `/v3/projects/f095c0252e3342b7b464b3175ac014c7/users/c3b5100be9e143758f31a89be68363d9/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.655651 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f095c0252e3342b7b464b3175ac014c7, user_id=c3b5100be9e143758f31a89be68363d9, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.658669 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.673078 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1382/2784] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:20 2022] PUT /identity/v3/projects/f095c0252e3342b7b464b3175ac014c7/users/c3b5100be9e143758f31a89be68363d9/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:20.677172 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.687493 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad05bf-7902-45f1-b6db-52646ba322ed admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.740583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.742387 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.747548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.748277 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.748588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.748895 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.749631 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.751338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.762438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1403/2785] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:20.766230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.768086 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c831f-1ba4-475a-81e6-c973c80d43df admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.773015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.773829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.774068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.774336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] PATH_INFO: `/v3/projects/e831bdf1f8ed4d7391458e1323be4e67` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.775530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e831bdf1f8ed4d7391458e1323be4e67)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.777337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbcae-a859-44e5-8324-5901f8c04e3d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:20.777472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.781984 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:20.783642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.783962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.784248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] PATH_INFO: `/v3/projects/f095c0252e3342b7b464b3175ac014c7/users/c3b5100be9e143758f31a89be68363d9/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.786304 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f095c0252e3342b7b464b3175ac014c7, user_id=c3b5100be9e143758f31a89be68363d9, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:20.788977 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93172126-6ce4-4852-8d0f-ce75617cb088 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:20.800960 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1404/2786] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:20 2022] PUT /identity/v3/projects/f095c0252e3342b7b464b3175ac014c7/users/c3b5100be9e143758f31a89be68363d9/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:20.812155 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:20.812578 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:20.813038 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:20.828753 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e831bdf1f8ed4d7391458e1323be4e67', 'request_id': 'req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.837242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e831bdf1f8ed4d7391458e1323be4e67', 'request_id': 'req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.840739 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] MFA Rules not processed for user `c3b5100be9e143758f31a89be68363d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:20.842153 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.846570 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e831bdf1f8ed4d7391458e1323be4e67', 'request_id': 'req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.857618 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] The token cache is being invalidate because project e831bdf1f8ed4d7391458e1323be4e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:20.857906 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.858536 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:20.860149 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1383/2787] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:20 2022] DELETE /identity/v3/projects/e831bdf1f8ed4d7391458e1323be4e67 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:20.922608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1405/2788] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:20.934269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:20.935893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:20.998178 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c20af-a63c-4d12-9c5a-9a1c2c518b09 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:21.002772 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:21.003454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:21.003759 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:21.004042 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:21.014220 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:21.015734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:21.027015 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1384/2789] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:21.129537 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:21.140044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602537b-ac2a-4589-b63b-5693625c87a0 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:21.144165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:21.144823 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:21.145105 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:21.145384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:21.147161 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:21.206897 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:21.208318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb043b-80c1-4579-8de3-d9471cc1086a service cinder] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:21.217450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1406/2790] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:24.648922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:24.650677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:24.723532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5b96-e436-43ce-93e5-4d7ede0bf532 service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:24.729573 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:24.730457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:24.730736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:24.731005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] PATH_INFO: `/v3/users/236c87ac79b84605919a7f75c75e43fc` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:24.732336 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236c87ac79b84605919a7f75c75e43fc)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:24.734260 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:24.784907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236c87ac79b84605919a7f75c75e43fc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.797652 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236c87ac79b84605919a7f75c75e43fc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.798425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236c87ac79b84605919a7f75c75e43fc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.799125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236c87ac79b84605919a7f75c75e43fc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.809356 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236c87ac79b84605919a7f75c75e43fc'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.822916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1385/2791] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:24 2022] DELETE /identity/v3/users/236c87ac79b84605919a7f75c75e43fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:24.827590 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:24.828102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:24.828204 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:24.841741 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:24.843312 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:24.847042 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:24.848274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:24.905658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed072-d23e-47c1-ab7e-86181e95ac23 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:24.908136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1407/2792] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:24.910384 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:24.911301 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:24.911583 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:24.912287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] PATH_INFO: `/v3/users/f09a1dd7ea434ab8b01d946bf3ff4b24` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:24.913182 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09a1dd7ea434ab8b01d946bf3ff4b24)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:24.915143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:24.918450 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:24.919865 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:24.962156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09a1dd7ea434ab8b01d946bf3ff4b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.973474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09a1dd7ea434ab8b01d946bf3ff4b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.975137 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09a1dd7ea434ab8b01d946bf3ff4b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.975804 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09a1dd7ea434ab8b01d946bf3ff4b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.975937 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8e134-24e4-43f8-802a-bd755740d213 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:24.979540 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:24.980323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:24.980638 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:24.981186 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:24.983343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:24.984967 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-61d99125-eafa-4620-92ff-6c5695645aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09a1dd7ea434ab8b01d946bf3ff4b24'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:24.995769 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:24.997209 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:24.997504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1386/2793] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:24 2022] DELETE /identity/v3/users/f09a1dd7ea434ab8b01d946bf3ff4b24 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:51:25.001902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:25.002189 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:25.002463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:25.007160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1408/2794] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:51:25.021396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:25.022598 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:25.080856 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1387/2795] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:25.090848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:25.092307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:25.103565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a0889-207b-4791-b936-52abc74b774a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:25.157288 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:25.158084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:25.158368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:25.158642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:25.170034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:25.171972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:25.182628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1409/2796] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:25.324038 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:25.325529 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:25.338118 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f52d65-07a7-4817-948a-b40412a66c62 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:25.355082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:25.356197 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:25.356515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:25.357059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] PATH_INFO: `/v3/projects/bfde9adfbfb34784b01e71d2b9b683f3` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:25.358656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfde9adfbfb34784b01e71d2b9b683f3)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:25.361165 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:25.413389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfde9adfbfb34784b01e71d2b9b683f3', 'request_id': 'req-01b974a8-983a-4e3f-89df-bb0af010814d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.419318 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfde9adfbfb34784b01e71d2b9b683f3', 'request_id': 'req-01b974a8-983a-4e3f-89df-bb0af010814d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.428787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfde9adfbfb34784b01e71d2b9b683f3', 'request_id': 'req-01b974a8-983a-4e3f-89df-bb0af010814d'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.441286 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] The token cache is being invalidate because project bfde9adfbfb34784b01e71d2b9b683f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:25.441581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.442298 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.444808 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1388/2797] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:25 2022] DELETE /identity/v3/projects/bfde9adfbfb34784b01e71d2b9b683f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:25.535420 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:25.537499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:25.552500 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485aac-d6d1-493e-984b-79ab08eb1874 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:25.617441 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:25.618338 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:25.618617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:25.618890 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] PATH_INFO: `/v3/projects/dc8592d81bee47f79889df59452c7abb` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:25.620219 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8592d81bee47f79889df59452c7abb)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:25.622655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:25.674202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8592d81bee47f79889df59452c7abb', 'request_id': 'req-387cee2b-dae8-4ef6-b9d3-79b4062ca354'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.679803 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8592d81bee47f79889df59452c7abb', 'request_id': 'req-387cee2b-dae8-4ef6-b9d3-79b4062ca354'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.688856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8592d81bee47f79889df59452c7abb', 'request_id': 'req-387cee2b-dae8-4ef6-b9d3-79b4062ca354'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.702175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] The token cache is being invalidate because project dc8592d81bee47f79889df59452c7abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:25.702464 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.703158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.704795 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1410/2798] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:25 2022] DELETE /identity/v3/projects/dc8592d81bee47f79889df59452c7abb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:25.709239 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:25.710675 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:25.724883 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b974a8-983a-4e3f-89df-bb0af010814d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:25.782921 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:25.783841 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:25.784119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:25.784400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] PATH_INFO: `/v3/users/c3b5100be9e143758f31a89be68363d9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:25.785650 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b5100be9e143758f31a89be68363d9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:25.787604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:25.846335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b5100be9e143758f31a89be68363d9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.858591 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b5100be9e143758f31a89be68363d9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.859363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b5100be9e143758f31a89be68363d9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.860076 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b5100be9e143758f31a89be68363d9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.869557 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-379cd097-98bd-4648-aa61-2e3c90a5995d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b5100be9e143758f31a89be68363d9'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:25.887345 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1389/2799] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:25 2022] DELETE /identity/v3/users/c3b5100be9e143758f31a89be68363d9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:26.171028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.173084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:26.186453 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cee2b-dae8-4ef6-b9d3-79b4062ca354 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.242994 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.243923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.244206 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.244480 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] PATH_INFO: `/v3/projects/f095c0252e3342b7b464b3175ac014c7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.245752 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f095c0252e3342b7b464b3175ac014c7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.247677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.301163 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f095c0252e3342b7b464b3175ac014c7', 'request_id': 'req-49c7520a-c297-4c7a-8b9e-22b527e3d12a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:26.306945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f095c0252e3342b7b464b3175ac014c7', 'request_id': 'req-49c7520a-c297-4c7a-8b9e-22b527e3d12a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:26.315882 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f095c0252e3342b7b464b3175ac014c7', 'request_id': 'req-49c7520a-c297-4c7a-8b9e-22b527e3d12a'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:26.327265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] The token cache is being invalidate because project f095c0252e3342b7b464b3175ac014c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:26.327555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:26.328315 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-49c7520a-c297-4c7a-8b9e-22b527e3d12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:26.329970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1411/2800] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:26 2022] DELETE /identity/v3/projects/f095c0252e3342b7b464b3175ac014c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:26.335230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.335493 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.335829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.353459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:26.354677 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:26.416179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1390/2801] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:26.426497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.426913 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.427300 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.447284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:26.448467 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:26.458061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1412/2802] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:26.462558 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.473101 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2768b79-1854-4cdc-9424-b53307cf3fb9 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.479167 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.479876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.480156 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.480425 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.481157 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:26.481459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.483067 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.495917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1391/2803] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:51:26.500408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.510021 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d893d-a183-44e2-8f04-e02f103e82d2 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.516116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.516777 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.517044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.517319 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.518070 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.520031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.550343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1413/2804] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:26 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:26.554530 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.564411 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69b8cf-7329-492f-933c-70db59a43d8a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.636621 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.637496 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.637838 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.638164 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.639191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.642083 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.666292 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1392/2805] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:26 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:26.670848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.681414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6f3a-c353-4bcf-b70c-d92abfe801e2 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.686060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.686722 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.687007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.687278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.688058 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.689661 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.700007 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1414/2806] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:26.703998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.714609 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535932ef-26b6-412c-bef3-ecdb1461cb9d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.719793 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.720473 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.720767 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.721043 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.721780 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.723438 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbf445-9452-4374-bb85-a28b1d8e82f3 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.733582 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1393/2807] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:26.737921 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.748088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd38b-02f5-4040-b78b-20e0f6d0793d admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.753143 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.754096 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.754371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.754642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] PATH_INFO: `/v3/projects/df5a4623a07f491f846fcefdd888376f/users/dd76459f8e2c44f0a5d007d477783dc7/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.769866 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5a4623a07f491f846fcefdd888376f, user_id=dd76459f8e2c44f0a5d007d477783dc7, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:26.772592 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:26.787431 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1415/2808] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:26 2022] PUT /identity/v3/projects/df5a4623a07f491f846fcefdd888376f/users/dd76459f8e2c44f0a5d007d477783dc7/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:26.803946 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.804326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.804721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:26.836200 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] MFA Rules not processed for user `dd76459f8e2c44f0a5d007d477783dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:26.837427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:26.901595 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1394/2809] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:26.913621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:26.915600 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:26.989302 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d67858-c9c0-448d-9efa-56c033b8efeb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:26.993861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:26.994519 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:26.994800 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:26.995095 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:27.004666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:27.006318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:27.015499 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1416/2810] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:40.879734 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:40.882034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:40.994107 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214349-030d-478d-8ca6-39e5b7758f86 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:41.001578 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:41.002254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:41.002534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:41.002806 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:41.005246 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:41.018036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:41.019626 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244861d8-c33f-4511-b439-96992ae1618b service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:41.030309 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1395/2811] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:49.968472 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:50.037075 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e91-a28f-4583-bd05-6cb9557dc67a service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:50.043334 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:50.044256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:50.044534 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:50.044813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] PATH_INFO: `/v3/users/dd76459f8e2c44f0a5d007d477783dc7` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:50.046106 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd76459f8e2c44f0a5d007d477783dc7)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:50.048083 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:50.105336 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd76459f8e2c44f0a5d007d477783dc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.117486 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd76459f8e2c44f0a5d007d477783dc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.124660 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd76459f8e2c44f0a5d007d477783dc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.125484 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd76459f8e2c44f0a5d007d477783dc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.134958 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd76459f8e2c44f0a5d007d477783dc7'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.144414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1417/2812] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:51:49 2022] DELETE /identity/v3/users/dd76459f8e2c44f0a5d007d477783dc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:50.149432 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:50.150017 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:50.150308 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:50.169708 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:50.170902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:50.234300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1396/2813] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:50.247605 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:50.250118 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:50.315513 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f97ea-07a6-4964-bdc9-466822846ca5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:50.319907 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:50.320560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:50.320839 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:50.321115 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:50.335179 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:50.337213 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c607-01bd-47c3-a13a-b1b73ef3d972 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:50.350940 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1418/2814] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:51:50.887472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:50.889090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:50.905206 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e217d8-e6df-4cd2-8d69-b4b74cb2b752 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:50.911145 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:50.912115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:50.912505 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:50.912686 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] PATH_INFO: `/v3/projects/df5a4623a07f491f846fcefdd888376f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:50.913894 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5a4623a07f491f846fcefdd888376f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:50.915933 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:50.965560 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5a4623a07f491f846fcefdd888376f', 'request_id': 'req-376488ef-1dd2-43a2-8db2-234c3eb95fdf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.970646 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5a4623a07f491f846fcefdd888376f', 'request_id': 'req-376488ef-1dd2-43a2-8db2-234c3eb95fdf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.981366 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5a4623a07f491f846fcefdd888376f', 'request_id': 'req-376488ef-1dd2-43a2-8db2-234c3eb95fdf'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.992213 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] The token cache is being invalidate because project df5a4623a07f491f846fcefdd888376f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:51:50.992499 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.993121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-376488ef-1dd2-43a2-8db2-234c3eb95fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:51:50.994678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1397/2815] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:51:50 2022] DELETE /identity/v3/projects/df5a4623a07f491f846fcefdd888376f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:50.999713 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.000265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.000265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.017775 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:51.018965 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:51.081710 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1419/2816] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:51:51.089977 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.090267 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.090546 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.110051 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:51.111254 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:51.120506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1398/2817] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:51.126280 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.136502 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726a428-d612-4987-beb8-86800ac51dbf None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.142301 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.142962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.143229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.143497 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.144262 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:51:51.144571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.146468 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.158479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1420/2818] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:51:51.163175 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.173643 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411b8a-e8ac-4881-ac94-a60130e1c604 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.180034 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.180817 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.181112 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.181400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.182090 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.184093 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.212363 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1399/2819] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:51:51 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:51.216561 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.226974 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ba273-0a16-472f-a4a8-ba139b66a851 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.285185 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.285898 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.286224 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.286510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.287242 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.289289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.310046 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1421/2820] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:51:51 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:51:51.314310 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.325504 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd821a26-e229-42f7-b499-a0d9f87c4352 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.331234 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.331983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.332207 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.332477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.333245 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.335130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.346060 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1400/2821] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:51.350039 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.360085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead85fae-73fd-4ffd-8b74-eb4d3f0de1cb admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.364970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.365624 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.365925 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.366197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.366922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.368569 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a06392-b508-4940-a352-b97f569c461d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.378248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1422/2822] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:51:51.382323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.392113 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afdced-cac4-4cf9-9ace-5f1b6065fc95 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.396934 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.397785 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.398059 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.398330 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] PATH_INFO: `/v3/projects/3ca9ad16cf8b4904b6ba39aea950d5aa/users/e57080d357414d2c93cb26148e2ee4d4/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.412459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca9ad16cf8b4904b6ba39aea950d5aa, user_id=e57080d357414d2c93cb26148e2ee4d4, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.415105 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.430786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1401/2823] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:51:51 2022] PUT /identity/v3/projects/3ca9ad16cf8b4904b6ba39aea950d5aa/users/e57080d357414d2c93cb26148e2ee4d4/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:51:51.442001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.442325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.442749 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.472034 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] MFA Rules not processed for user `e57080d357414d2c93cb26148e2ee4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:51:51.473243 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:51.545932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1423/2824] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:51:51.557800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:51:51.559855 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:51:51.624700 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306249d-845b-436a-9d94-134bdd0f80aa admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:51:51.631409 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:51:51.632115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:51:51.632393 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:51:51.632665 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:51:51.642335 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:51:51.643857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14db76-2335-4538-9ffe-9a92b8efbecc service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:51:51.653488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1402/2825] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:13.290891 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:13.357836 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831de1f-003d-4fad-9e17-162f11268bab None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:13.363140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:13.364103 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:13.364385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:13.364659 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] PATH_INFO: `/v3/users/e57080d357414d2c93cb26148e2ee4d4` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:13.365945 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57080d357414d2c93cb26148e2ee4d4)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:13.367920 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:13.422941 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57080d357414d2c93cb26148e2ee4d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:13.436487 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57080d357414d2c93cb26148e2ee4d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:13.444102 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57080d357414d2c93cb26148e2ee4d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:13.444816 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57080d357414d2c93cb26148e2ee4d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:13.454658 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57080d357414d2c93cb26148e2ee4d4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:13.460879 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1424/2826] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:52:13 2022] DELETE /identity/v3/users/e57080d357414d2c93cb26148e2ee4d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:52:13.465703 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:13.466188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:13.466370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:13.485095 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:13.486332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:13.548343 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1403/2827] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:13.558325 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:13.559972 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:13.617248 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8792d8-dce1-408f-a1fa-45c7f8f204fe admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:13.621060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:13.621717 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:13.622001 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:13.622278 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:13.631389 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:13.632870 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5613d9b-69aa-4e1b-9a1b-93bc3acff27c service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:13.642321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1425/2828] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:13.933319 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:13.934893 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:13.947299 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67a039-8ad0-4899-acf7-bfc2b386010f None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:13.958832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:13.958832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:13.958832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:13.958832 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] PATH_INFO: `/v3/projects/3ca9ad16cf8b4904b6ba39aea950d5aa` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:13.959333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca9ad16cf8b4904b6ba39aea950d5aa)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:13.959333 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.008179 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca9ad16cf8b4904b6ba39aea950d5aa', 'request_id': 'req-5af0c720-990b-44ab-8e2c-5392726bfc22'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:14.013400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca9ad16cf8b4904b6ba39aea950d5aa', 'request_id': 'req-5af0c720-990b-44ab-8e2c-5392726bfc22'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:14.021822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca9ad16cf8b4904b6ba39aea950d5aa', 'request_id': 'req-5af0c720-990b-44ab-8e2c-5392726bfc22'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:14.032688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] The token cache is being invalidate because project 3ca9ad16cf8b4904b6ba39aea950d5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80038) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:52:14.032974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:14.033735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-5af0c720-990b-44ab-8e2c-5392726bfc22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:52:14.035507 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1404/2829] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:52:13 2022] DELETE /identity/v3/projects/3ca9ad16cf8b4904b6ba39aea950d5aa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:52:14.040715 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.041004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.041282 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.060066 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:14.061193 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:14.140856 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1426/2830] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:14.150688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.150978 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.151265 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.171314 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:14.172549 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:14.182485 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1405/2831] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:14.186847 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.196799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eabd7-8452-47e0-9a13-37dfea351d1c None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.201917 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.202577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.202851 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.203169 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.203922 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80037) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:52:14.204227 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.205814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.217476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1427/2832] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:52:14.222151 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.231916 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e299-9973-4c5d-8071-d762b6b235ac None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.237120 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.237787 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.238068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.238442 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.239219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.241160 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.270533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1406/2833] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:52:14.277045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.293160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce945-9cb4-4b05-bfb4-c106bc371039 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.355318 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.356035 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.356320 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.356596 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.357285 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.359214 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.382140 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1428/2834] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:52:14 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:52:14.387004 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.400510 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235775ce-4b67-4a39-9936-45eabc5cce47 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.406194 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.406864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.407144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.407414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.408185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.409810 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.420935 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1407/2835] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:52:14.425762 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.442003 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dff32-fb44-4781-88d8-072af0f33195 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.448025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.448690 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.448964 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.449231 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.449955 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.451542 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb9005-45d1-4228-beaf-0db562c40ae4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.462647 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1429/2836] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:52:14.466915 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.477623 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e6f3-a2fe-4001-9e08-b6ca2a5a9ce8 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.483926 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.484826 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.485106 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.485383 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] PATH_INFO: `/v3/projects/7557d7be043140c29f88052c05ba38be/users/cbe380821fbb421483675afa367066c5/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.503498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7557d7be043140c29f88052c05ba38be, user_id=cbe380821fbb421483675afa367066c5, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.506523 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.522947 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1408/2837] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:52:14 2022] PUT /identity/v3/projects/7557d7be043140c29f88052c05ba38be/users/cbe380821fbb421483675afa367066c5/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:52:14.528408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede2a3-784e-4799-b7c6-00af55476ed8 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.528695 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede2a3-784e-4799-b7c6-00af55476ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.528969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede2a3-784e-4799-b7c6-00af55476ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.548079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-29ede2a3-784e-4799-b7c6-00af55476ed8 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:14.549259 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-29ede2a3-784e-4799-b7c6-00af55476ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:14.615337 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1430/2838] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:14.627533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:14.629508 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:14.692294 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4096f13-f97b-46b2-a17f-b1981936f54d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:14.696454 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:14.697103 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:14.697386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:14.697641 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:14.708266 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:14.709757 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:14.724243 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1409/2839] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:52:18.637887 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:18.638466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:18.638466 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:18.668462 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] MFA Rules not processed for user `cbe380821fbb421483675afa367066c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:18.669202 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:18.734031 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1431/2840] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:18.739735 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:18.749637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542efe57-08dd-421d-b866-b82faa1c39f9 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:18.754565 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:18.755441 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:18.755748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:18.756027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:18.756721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:18.758678 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:18.786501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1410/2841] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:52:18 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:52:18.790889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:18.802568 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc50b05-4a53-4b65-b920-969808480ba5 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:18.863779 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:18.865291 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:18.865505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:18.865789 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:18.866560 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:18.868587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:18.896554 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1432/2842] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:52:18 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:52:18.897907 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:18.909249 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348231-9fe8-4406-b02e-92dc1e0cf10d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:18.914637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:18.915397 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:18.915864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:18.916211 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:18.917527 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:18.919232 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:18.934050 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1411/2843] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:52:18.935438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:18.947992 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e2dbb-8eb7-4629-9c39-f901197c05b5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:18.953222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:18.954146 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:18.954429 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:18.954702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] PATH_INFO: `/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c/users/3c5f4aed5c4a4a139ae12c1cc4359c1f/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:18.970702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a9fa6b0a3343008b95fdd5fb4b443c, user_id=3c5f4aed5c4a4a139ae12c1cc4359c1f, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:18.973479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:18.990349 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1433/2844] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:52:18 2022] PUT /identity/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c/users/3c5f4aed5c4a4a139ae12c1cc4359c1f/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:52:18.994671 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:19.006602 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acfda-7e0c-47ca-9e37-8a933a123e15 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:19.074244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95882708-604e-484e-a970-35941fd98379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:19.075269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882708-604e-484e-a970-35941fd98379 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:19.075620 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882708-604e-484e-a970-35941fd98379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:19.076181 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95882708-604e-484e-a970-35941fd98379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:19.076985 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95882708-604e-484e-a970-35941fd98379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:19.079248 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95882708-604e-484e-a970-35941fd98379 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:19.095608 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1412/2845] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:52:19.100571 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:19.120505 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b144-a495-4fab-9de3-5c3c532405c3 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:19.130565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:19.131663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:19.132045 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:19.132391 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] PATH_INFO: `/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c/users/3c5f4aed5c4a4a139ae12c1cc4359c1f/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:19.134699 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a9fa6b0a3343008b95fdd5fb4b443c, user_id=3c5f4aed5c4a4a139ae12c1cc4359c1f, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:19.137512 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:19.149494 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1434/2846] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:52:19 2022] PUT /identity/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c/users/3c5f4aed5c4a4a139ae12c1cc4359c1f/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:52:23.982326 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e083-0ab7-415c-9ab8-acba1daae468 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:23.982914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e083-0ab7-415c-9ab8-acba1daae468 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:23.982914 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e083-0ab7-415c-9ab8-acba1daae468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:24.011746 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-2b22e083-0ab7-415c-9ab8-acba1daae468 None None] MFA Rules not processed for user `3c5f4aed5c4a4a139ae12c1cc4359c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:24.012857 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2b22e083-0ab7-415c-9ab8-acba1daae468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:24.083830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1413/2847] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:24.095876 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:24.097643 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:24.184041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27afd6-6b41-4143-a093-eed0a27d40c1 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:24.188192 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:24.188967 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:24.189377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:24.189655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:24.244821 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:24.246266 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:24.255831 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1435/2848] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:24.369426 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd42f-8b50-4b18-8b03-cfb22cb5833f None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:24.369998 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd42f-8b50-4b18-8b03-cfb22cb5833f None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:24.370487 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd42f-8b50-4b18-8b03-cfb22cb5833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:24.433954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-f36fd42f-8b50-4b18-8b03-cfb22cb5833f None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:24.435282 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f36fd42f-8b50-4b18-8b03-cfb22cb5833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:24.523533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1414/2849] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:24.585587 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:24.587018 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:24.678990 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d71e-b1ba-413e-a6eb-3cbd4151c77f service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:24.684210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:24.684873 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:24.685158 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:24.685435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:24.694599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:24.696245 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:24.705020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1436/2850] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:52:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:52:34.369534 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:34.370039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:34.370141 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:34.389121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] MFA Rules not processed for user `cbe380821fbb421483675afa367066c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:34.390332 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:34.398147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1415/2851] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:52:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:34.436343 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:34.450589 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90732eff-d3c2-4a07-93ae-547f2d0fe8dc service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:34.457000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f11c04b2350b44c6a9dd95acf914fc69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:34.458000 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:34.458294 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:34.458565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:34.460454 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:34.557628 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:34.558993 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:34.580414 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1437/2852] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:34.817829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:34.876517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510fd9-c5b3-42cd-ab5c-e19f127e267a None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:34.881230 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:34.881899 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:34.882188 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:34.882463 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:34.884670 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:34.896498 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:34.897954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:34.907027 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1416/2853] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:35.278119 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:35.291175 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b009-3a93-41fe-960d-89a904b951a3 service glance] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:35.297322 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:35.297987 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:35.298274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:35.298547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:35.300577 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:35.317986 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:35.320271 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea18e1-7ef6-43b3-8252-3f8b32a5abab service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:35.336357 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1438/2854] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:36.297561 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:36.299278 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:36.380559 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc3f9-805e-4b77-826d-71598f9d2fbe service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:36.386800 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:36.387465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:36.387777 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:36.388047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:36.390005 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:36.404087 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:36.406601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:36.418484 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1417/2855] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:52:40.802804 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:40.803321 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:40.803409 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:40.831971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:52:40.833229 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:52:40.848476 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1439/2856] 10.222.0.79 () {58 vars in 1009 bytes} [Thu May 12 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:52:40.862079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:52:40.874030 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71ec1-99bf-4f7e-a1bf-4770c7e743c7 service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:52:40.879406 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:52:40.880102 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:52:40.880389 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:52:40.881049 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:52:40.890732 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:52:40.892533 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:52:40.901114 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1418/2857] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:52:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:53:00.573296 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:53:00.574950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:53:00.595342 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929a645-e76f-46fb-afe6-879f6860a873 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:53:00.601975 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:53:00.602642 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:53:00.603081 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:53:00.603359 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:53:00.605310 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:53:00.618313 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:53:00.619923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:53:00.630666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1440/2858] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:53:13.882581 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:53:13.892748 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a08cd-1921-4b12-bb33-bcede81f3056 service swift] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:53:13.897235 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:53:13.897922 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:53:13.898198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:53:13.898466 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:53:13.908036 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:53:13.909472 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:53:13.919501 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1419/2859] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:53:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:53:43.092894 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:53:43.103060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cd86-9690-4481-8b17-e52620dbcc9e service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:53:43.107614 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:53:43.108292 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:53:43.108599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:53:43.108881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:53:43.110933 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:53:43.121050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:53:43.122655 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:53:43.131009 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1441/2860] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:55:26.448289 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:26.460950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619a527-e13b-4cad-b625-9806f71b5781 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:26.467830 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:26.469046 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:26.469410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:26.469674 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:26.472094 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:26.492437 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:26.495269 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476a741-34ce-4ef4-b609-30979abad784 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:26.512854 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1420/2861] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:55:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:55:27.654112 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:27.670662 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443107-71d7-424b-b14d-b1f17e6b7bf0 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:27.677254 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:27.678162 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:27.678444 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:27.678718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:27.680799 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:27.696368 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:27.699148 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:27.713032 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1442/2862] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:55:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:55:35.114218 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:35.114721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:35.114721 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:35.134331 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] MFA Rules not processed for user `e1b7478c84744e0e80ebda09dca94998`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:35.135524 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:35.144126 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1421/2863] 10.222.0.79 () {58 vars in 967 bytes} [Thu May 12 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:35.193173 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:35.207108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922091db-05ae-4f31-821f-b8cb2448ee8a service nova] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:35.213508 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8771b05277f14efa9650690aae4587f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:35.214435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:35.214720 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:35.214998 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:35.223408 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:35.225043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:35.233784 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1443/2864] 10.222.0.79 () {60 vars in 1384 bytes} [Thu May 12 14:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:55:42.511148 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:42.573936 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42231e40-b80e-428b-a1b7-d456d329cfe1 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:42.578822 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:42.579807 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:42.580130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:42.580457 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] PATH_INFO: `/v3/users/cbe380821fbb421483675afa367066c5` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:42.581667 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe380821fbb421483675afa367066c5)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:42.583604 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:42.635039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe380821fbb421483675afa367066c5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.647736 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe380821fbb421483675afa367066c5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.648489 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe380821fbb421483675afa367066c5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.649274 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe380821fbb421483675afa367066c5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.659338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe380821fbb421483675afa367066c5'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.672198 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1422/2865] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:55:42 2022] DELETE /identity/v3/users/cbe380821fbb421483675afa367066c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:42.850681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:42.861608 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1db3-dece-43df-89a6-4ddd353753aa service swift] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:42.919384 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:42.920520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:42.920813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:42.921026 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] PATH_INFO: `/v3/projects/7557d7be043140c29f88052c05ba38be` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:42.922265 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7557d7be043140c29f88052c05ba38be)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:42.924376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:42.986814 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7557d7be043140c29f88052c05ba38be', 'request_id': 'req-270ee2e9-055d-4073-8521-7a278bc82419'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:42.992705 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7557d7be043140c29f88052c05ba38be', 'request_id': 'req-270ee2e9-055d-4073-8521-7a278bc82419'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.002060 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7557d7be043140c29f88052c05ba38be', 'request_id': 'req-270ee2e9-055d-4073-8521-7a278bc82419'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.014088 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] The token cache is being invalidate because project 7557d7be043140c29f88052c05ba38be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:55:43.014376 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.015027 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.016675 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1444/2866] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:55:42 2022] DELETE /identity/v3/projects/7557d7be043140c29f88052c05ba38be => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:43.020711 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.022300 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:43.036704 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae0dcd-aae9-48f9-8446-f6dc1cc0204a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.101190 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.102098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.102375 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.102656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] PATH_INFO: `/v3/users/3c5f4aed5c4a4a139ae12c1cc4359c1f` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.103882 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5f4aed5c4a4a139ae12c1cc4359c1f)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.105839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.153242 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5f4aed5c4a4a139ae12c1cc4359c1f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.165401 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5f4aed5c4a4a139ae12c1cc4359c1f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.166082 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5f4aed5c4a4a139ae12c1cc4359c1f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.167053 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5f4aed5c4a4a139ae12c1cc4359c1f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.176628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-60cf6ec0-fc04-4dcc-841b-f405ea64e29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5f4aed5c4a4a139ae12c1cc4359c1f'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.190140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1423/2867] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 14:55:43 2022] DELETE /identity/v3/users/3c5f4aed5c4a4a139ae12c1cc4359c1f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:43.379985 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.381618 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:43.394364 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ee2e9-055d-4073-8521-7a278bc82419 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.451004 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.451926 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.452210 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.452478 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] PATH_INFO: `/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.453718 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a9fa6b0a3343008b95fdd5fb4b443c)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.455677 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.502369 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a9fa6b0a3343008b95fdd5fb4b443c', 'request_id': 'req-8e67accf-2826-4ee8-a6bf-14bd00a634f4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.507716 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a9fa6b0a3343008b95fdd5fb4b443c', 'request_id': 'req-8e67accf-2826-4ee8-a6bf-14bd00a634f4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.516011 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a9fa6b0a3343008b95fdd5fb4b443c', 'request_id': 'req-8e67accf-2826-4ee8-a6bf-14bd00a634f4'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.528284 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] The token cache is being invalidate because project b9a9fa6b0a3343008b95fdd5fb4b443c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:55:43.528557 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.529298 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-8e67accf-2826-4ee8-a6bf-14bd00a634f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:55:43.530953 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1445/2868] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 14:55:43 2022] DELETE /identity/v3/projects/b9a9fa6b0a3343008b95fdd5fb4b443c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:43.537263 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.538008 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.538131 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.558981 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:43.560537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:43.626515 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1424/2869] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:43.640015 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.640316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.640599 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.660676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:43.661902 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:43.672305 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1446/2870] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:43.676731 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.687223 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bbe30-57ce-4407-8973-546ceebb47e4 None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.693176 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.693851 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.694133 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.694407 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.695143 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80038) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:55:43.695467 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.697116 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.709506 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1425/2871] 10.222.0.79 () {58 vars in 1152 bytes} [Thu May 12 14:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:55:43.714044 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.724072 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fede-0652-4a03-8acc-9896ce0c7f7d None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.733805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.734473 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.734753 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.735028 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.735719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.737758 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.777756 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1447/2872] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:55:43 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:55:43.782140 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.793203 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69fe0-856a-4dc0-b075-9e489f7bf990 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.861130 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.861813 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.862079 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.862355 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.863047 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.865033 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.888695 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1426/2873] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:55:43 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:55:43.893063 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.907681 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e70d3-5516-41e3-af70-998cb32db6b0 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.912947 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.913652 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.913931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.914203 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.914931 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.916565 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.927488 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1448/2874] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:55:43.931654 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.942360 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e557cb2-ef78-49eb-a33a-eadee31e9f7b admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.948465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.949132 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.949428 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.949656 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:43.950469 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:43.952370 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ad44b-7452-407f-b505-01d45fc3e351 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:43.962999 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1427/2875] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:55:43.967461 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:43.978157 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445c1c-cf84-47b9-8fe7-b1fe2a8426a5 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:43.984630 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:43.985528 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:43.985811 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:43.986084 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] PATH_INFO: `/v3/projects/2f03df9aaaa743058d78385df499c624/users/dcf927fe5196454e96ab65e6cda3e1b8/roles/0aa03b4dadae4241965d05deeadb2759` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:44.002117 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f03df9aaaa743058d78385df499c624, user_id=dcf927fe5196454e96ab65e6cda3e1b8, role_id=0aa03b4dadae4241965d05deeadb2759)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:44.004889 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:44.020547 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1449/2876] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:55:43 2022] PUT /identity/v3/projects/2f03df9aaaa743058d78385df499c624/users/dcf927fe5196454e96ab65e6cda3e1b8/roles/0aa03b4dadae4241965d05deeadb2759 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:44.025896 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363dcd-2bbf-400f-b001-af30b90101ca None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:44.026185 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363dcd-2bbf-400f-b001-af30b90101ca None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:44.026459 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d363dcd-2bbf-400f-b001-af30b90101ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:44.045365 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-4d363dcd-2bbf-400f-b001-af30b90101ca None None] MFA Rules not processed for user `fa9ac61b8632465586bee816b0404515`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:44.046488 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-4d363dcd-2bbf-400f-b001-af30b90101ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:44.111215 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1428/2877] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:44.121166 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:44.123881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:44.183385 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-99cf-478b-91ea-563f5ca61a14 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:44.188524 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:44.189197 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:44.189479 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:44.189754 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:44.200064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:44.201576 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:44.211184 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1450/2878] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:55:48.243511 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.244098 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.244380 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.271969 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.auth.core [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] MFA Rules not processed for user `dcf927fe5196454e96ab65e6cda3e1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80038) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:48.273381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:48.348952 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1429/2879] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:48.353584 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.364257 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081beaa-1037-46e4-9e5a-6cee1ab1fb90 service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.369189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.369848 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.370281 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.370702 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] PATH_INFO: `/v3/projects` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.372260 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.374371 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.408669 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1451/2880] 10.222.0.79 () {60 vars in 1152 bytes} [Thu May 12 14:55:48 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:55:48.412917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.424778 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736d7c0-6fa2-49ab-be82-d6682ff1034e None None] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.482210 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.482911 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.483191 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.483471 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.484222 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.486171 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.508673 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1430/2881] 10.222.0.79 () {60 vars in 1143 bytes} [Thu May 12 14:55:48 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:55:48.513134 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.524150 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68807-d84a-44af-9cc9-1f9a3fd8156f admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.529190 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.529969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.530256 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.530541 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.531293 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.532961 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.544923 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1452/2882] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:55:48.548968 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.559410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f722a3-5417-4c54-9aae-4302cbf37d45 admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.564770 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.566214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.566214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.566214 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] PATH_INFO: `/v3/projects/d9caab7c594c42249ae8f0272fde6cc9/users/7cb0c687419f41aeb2156553572aa9eb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.582410 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9caab7c594c42249ae8f0272fde6cc9, user_id=7cb0c687419f41aeb2156553572aa9eb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.585313 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.600756 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1431/2883] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:55:48 2022] PUT /identity/v3/projects/d9caab7c594c42249ae8f0272fde6cc9/users/7cb0c687419f41aeb2156553572aa9eb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:48.604881 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.615176 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2c0dc-60bf-46a4-b1c4-d2d9cf666936 admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.672772 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.673621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.673932 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.674212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] PATH_INFO: `/v3/roles` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.675019 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.676728 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379894-fd42-4d6b-aa31-4ba893be943d admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.691230 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1453/2884] 10.222.0.79 () {58 vars in 1121 bytes} [Thu May 12 14:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:55:48.692628 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:48.704166 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917af9-24f0-4954-83e8-89c180c7ae2d admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:48.709743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:48.710720 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] REQUEST_METHOD: `PUT` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:48.711006 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:48.711284 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] PATH_INFO: `/v3/projects/d9caab7c594c42249ae8f0272fde6cc9/users/7cb0c687419f41aeb2156553572aa9eb/roles/2f57cc7438394c4089c6f602de8402b9` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:48.713431 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9caab7c594c42249ae8f0272fde6cc9, user_id=7cb0c687419f41aeb2156553572aa9eb, role_id=2f57cc7438394c4089c6f602de8402b9)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:48.716367 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:48.727791 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1432/2885] 10.222.0.79 () {60 vars in 1482 bytes} [Thu May 12 14:55:48 2022] PUT /identity/v3/projects/d9caab7c594c42249ae8f0272fde6cc9/users/7cb0c687419f41aeb2156553572aa9eb/roles/2f57cc7438394c4089c6f602de8402b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:55:53.230314 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af261-2432-489c-8731-e556dafadcbf None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:53.230838 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af261-2432-489c-8731-e556dafadcbf None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:53.230971 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0af261-2432-489c-8731-e556dafadcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:53.258247 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-3a0af261-2432-489c-8731-e556dafadcbf None None] MFA Rules not processed for user `7cb0c687419f41aeb2156553572aa9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:55:53.259377 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-3a0af261-2432-489c-8731-e556dafadcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:53.326423 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1454/2886] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:55:53.340244 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:53.342637 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:53.424476 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75f0cc-1bfd-41ed-a1d1-f18f7420194c admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:53.430444 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:53.431121 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:53.431404 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:53.431694 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:53.494323 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:53.496063 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:53.506474 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1433/2887] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:55:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:56:16.262394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:56:16.262950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:56:16.262950 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:56:16.282160 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] MFA Rules not processed for user `dcf927fe5196454e96ab65e6cda3e1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:56:16.283362 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:56:16.292617 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1455/2888] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:56:16.615895 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:56:16.676839 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f88f-5c3d-4b68-9096-60dcc098b441 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:56:16.683068 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:56:16.684125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:56:16.684784 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:56:16.685253 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:56:16.688726 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:56:16.703812 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:56:16.705346 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:56:16.713983 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1434/2889] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:56:34.188434 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:56:34.200085 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d227bc-9f03-426d-a6ca-0044af2927b9 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:56:34.203820 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:56:34.204483 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:56:34.204765 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:56:34.205041 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:56:34.214588 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:56:34.216309 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:56:34.227064 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1456/2890] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:56:48.137943 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:56:48.139566 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:56:48.222287 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa1c9-4709-4147-91af-4d22e8755887 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:56:48.228733 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:56:48.229400 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:56:48.229682 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:56:48.229950 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:56:48.232376 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:56:48.245614 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:56:48.247635 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:56:48.257958 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1435/2891] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:58:50.301449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:58:50.310962 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0889-849b-4768-a9b4-abd1f0d1861a service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:58:50.316037 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:58:50.316688 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:50.316970 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:50.317241 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:50.319348 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:50.339671 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:58:50.341137 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231361c-189d-4936-b552-01f522ebc7ac service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:58:50.352212 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1457/2892] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:58:51.555974 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:58:51.566192 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6991d-80b0-4567-a7c4-f9467d819d1d service placement] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:58:51.570699 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:58:51.571390 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:51.571910 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:51.572532 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:51.574554 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:51.588954 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:58:51.590396 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:58:51.602228 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1436/2893] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:58:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:58:55.029008 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:55.029526 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:55.029632 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:55.049297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] MFA Rules not processed for user `dcf927fe5196454e96ab65e6cda3e1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:58:55.050490 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:55.059737 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1458/2894] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:58:55.384710 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:58:55.394159 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd4df-610c-47c6-a135-145c2e96c32a service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:58:55.398944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:58:55.399601 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:55.399940 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:55.400219 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:55.402658 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:55.413340 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:58:55.414776 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:58:55.426405 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1437/2895] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:58:56.928666 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:58:56.942719 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faed91-a0dd-46ef-81d6-4ee7ff2d3232 None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:58:56.946723 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:58:56.947394 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:56.947676 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:56.948108 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:56.950449 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:56.963548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:58:56.965289 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:58:56.976529 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1459/2896] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:58:58.726743 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:58:58.739607 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2375f-eeda-470d-b8cf-e85f3121d980 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:58:58.744412 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:58:58.745477 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:58:58.746150 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:58:58.746435 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:58:58.748971 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:58:58.760786 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:58:58.762264 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:58:58.772696 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1438/2897] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:59:10.189306 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:59:10.191969 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:59:10.208818 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601f68-3ca2-4800-a5a6-1ba28cf477d5 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:59:10.215504 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:59:10.217020 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:59:10.218189 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:59:10.218802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:59:10.222410 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:59:10.252002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:59:10.253613 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995e897-92e5-44fd-95e9-fe6394de402b service nova] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:59:10.265079 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1460/2898] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:01:03.532057 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:01:03.534688 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:01:03.654427 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ed42-937a-432b-a15d-00d0fd3def25 service neutron] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:01:03.658864 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb6ff788d5841a3b627c60feaf44d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:01:03.659517 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:01:03.659829 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:01:03.660100 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:01:03.686003 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:01:03.687468 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:01:03.696963 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1439/2899] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:01:13.788861 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] REQUEST_METHOD: `POST` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:01:13.789438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:01:13.789438 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:01:13.808101 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.auth.core [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] MFA Rules not processed for user `dcf927fe5196454e96ab65e6cda3e1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80037) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 15:01:13.809317 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:01:13.818297 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1461/2900] 10.222.0.79 () {58 vars in 957 bytes} [Thu May 12 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 15:01:17.344224 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:01:17.374075 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593cc8-958d-403a-bc55-ace5c820ea9c service cinder] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:01:17.380139 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:01:17.381052 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:01:17.381503 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:01:17.381775 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:01:17.383572 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:01:17.396902 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:01:17.398876 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:01:17.410681 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1440/2901] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:01:50.437222 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:01:50.462621 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa3f5-b2ea-4c3c-a0fb-61e5e736369b None None] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:01:50.469883 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:01:50.470520 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:01:50.470802 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:01:50.471087 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:01:50.480714 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:01:50.482323 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:01:50.492597 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1462/2902] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:03:28.807849 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:28.846240 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93623-11c0-44e2-8594-c9dbc2107292 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:28.851840 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2801984340040c499b17ef6e0324033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:28.852518 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:28.852814 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:28.853077 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:28.854853 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:03:28.883388 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:28.885386 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:28.897525 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1441/2903] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:03:34.415116 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:34.434124 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742c49-2ac5-4b6a-aa69-cd0a20197640 service placement] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:34.437627 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cedef275f3404a3c8e618cb48f2afc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:34.438274 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] REQUEST_METHOD: `GET` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:34.438555 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:34.438829 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:34.508457 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:34.510211 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:34.532663 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1463/2904] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 15:03:40.963039 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:40.974403 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157e12-3411-4458-9024-89776c4b5bf0 service nova] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:40.979701 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:40.980616 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:40.980898 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:40.981172 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] PATH_INFO: `/v3/users/dcf927fe5196454e96ab65e6cda3e1b8` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:40.982381 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf927fe5196454e96ab65e6cda3e1b8)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:40.984357 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:41.038944 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf927fe5196454e96ab65e6cda3e1b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.051025 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf927fe5196454e96ab65e6cda3e1b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.051768 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf927fe5196454e96ab65e6cda3e1b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.052414 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf927fe5196454e96ab65e6cda3e1b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.061010 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf927fe5196454e96ab65e6cda3e1b8'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.073273 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1442/2905] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 15:03:40 2022] DELETE /identity/v3/users/dcf927fe5196454e96ab65e6cda3e1b8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 15:03:41.260822 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:41.272435 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f7216-8452-413b-b063-50f2fb86b90f service neutron] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:41.338844 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:41.339761 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:41.340043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:41.340316 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] PATH_INFO: `/v3/projects/2f03df9aaaa743058d78385df499c624` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:41.341510 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f03df9aaaa743058d78385df499c624)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:41.343404 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:41.394307 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f03df9aaaa743058d78385df499c624', 'request_id': 'req-924411dc-a852-4d5c-a6f1-4566055a955e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.400386 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f03df9aaaa743058d78385df499c624', 'request_id': 'req-924411dc-a852-4d5c-a6f1-4566055a955e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.410840 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f03df9aaaa743058d78385df499c624', 'request_id': 'req-924411dc-a852-4d5c-a6f1-4566055a955e'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.438535 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] The token cache is being invalidate because project 2f03df9aaaa743058d78385df499c624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 15:03:41.438805 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.439509 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.441061 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1464/2906] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 15:03:41 2022] DELETE /identity/v3/projects/2f03df9aaaa743058d78385df499c624 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 15:03:41.445769 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:41.448147 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:03:41.464685 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cc313-9c81-4b2f-85b0-5e269a89c14a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:41.521233 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:41.522115 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:41.522395 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:41.522661 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] PATH_INFO: `/v3/users/7cb0c687419f41aeb2156553572aa9eb` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:41.523990 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb0c687419f41aeb2156553572aa9eb)` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:41.525917 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:41.574119 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb0c687419f41aeb2156553572aa9eb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.586465 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb0c687419f41aeb2156553572aa9eb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.587202 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb0c687419f41aeb2156553572aa9eb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.587927 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb0c687419f41aeb2156553572aa9eb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.597258 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.notifications [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb0c687419f41aeb2156553572aa9eb'} {{(pid=80038) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.610751 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1443/2907] 10.222.0.79 () {58 vars in 1223 bytes} [Thu May 12 15:03:41 2022] DELETE /identity/v3/users/7cb0c687419f41aeb2156553572aa9eb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 15:03:41.808582 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Authenticating user token {{(pid=80037) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:03:41.810136 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.fernet_utils [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80037) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:03:41.828813 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924411dc-a852-4d5c-a6f1-4566055a955e admin admin] Validating token access rules against request {{(pid=80037) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:03:41.896328 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9ac61b8632465586bee816b0404515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da529673a2b348db8fa8b2ebc5773804', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80037) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:03:41.897225 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:03:41.897527 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:03:41.897771 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] PATH_INFO: `/v3/projects/d9caab7c594c42249ae8f0272fde6cc9` {{(pid=80037) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:03:41.899050 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9caab7c594c42249ae8f0272fde6cc9)` {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:03:41.901165 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] RBAC: Authorization granted {{(pid=80037) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:03:41.957548 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9caab7c594c42249ae8f0272fde6cc9', 'request_id': 'req-2355f282-c95c-4ab4-942f-55f66f9b6fab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.963002 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9caab7c594c42249ae8f0272fde6cc9', 'request_id': 'req-2355f282-c95c-4ab4-942f-55f66f9b6fab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.972043 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9caab7c594c42249ae8f0272fde6cc9', 'request_id': 'req-2355f282-c95c-4ab4-942f-55f66f9b6fab'} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.983110 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] The token cache is being invalidate because project d9caab7c594c42249ae8f0272fde6cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80037) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 15:03:41.983393 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.984025 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: DEBUG keystone.notifications [None req-2355f282-c95c-4ab4-942f-55f66f9b6fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80037) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 15:03:41.985573 dv-cinder-840678-8-iscsi devstack@keystone.service[80037]: [pid: 80037|app: 0|req: 1465/2908] 10.222.0.79 () {58 vars in 1232 bytes} [Thu May 12 15:03:41 2022] DELETE /identity/v3/projects/d9caab7c594c42249ae8f0272fde6cc9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 15:06:58.389662 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Authenticating user token {{(pid=80038) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 15:06:58.391338 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:06:58.484537 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc015d-9a88-4d5f-8e30-570a54b0264a admin admin] Validating token access rules against request {{(pid=80038) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 15:06:58.553205 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '053ed1bdb47c44fc8c581c1485fde6c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '548da44dc2034c3eb7cb3df5fc2c3dcf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80038) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 15:06:58.553881 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] REQUEST_METHOD: `GET` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 15:06:58.554144 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] SCRIPT_NAME: `/identity` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 15:06:58.554422 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80038) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 15:06:58.556872 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.fernet_utils [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80038) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 15:06:58.570490 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 15:06:58.572128 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15137eda-f491-43be-bb9f-3fe633a7b71a service placement] RBAC: Authorization granted {{(pid=80038) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 15:06:58.583125 dv-cinder-840678-8-iscsi devstack@keystone.service[80038]: [pid: 80038|app: 0|req: 1444/2909] 10.222.0.79 () {60 vars in 1365 bytes} [Thu May 12 15:06:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)